A workshop on Audiovisual Analysis at Schloss Dagstuhl, 10-14 February 2024.

https://www.dagstuhl.de/25072

Researchers met to discuss issues that arise from integrating visualisation and sonification, as well as topics that are of concern for each field individually and can potentially contribute to both areas. In particular, the following questions were discussed:

  • What are the strengths of visualization and sonification respectively and how can they best be used in unison, complementing and supporting where necessary, considering human perception as well as various data properties?
  • Which theoretical frameworks can be transferred from sonification to visualization and vice versa?
  • Visualization has progressed much in the past decades towards shared design methods and tools: What can sonification learn from this lesson? Are shared design methods and processes envisageable, or even desired? Can we imagine integrated tools for visualization and sonification?
  • In what way can audio-visual representations support accessibility of information and data?
  • Can audio-visual representations increase the engagement of their users during a data analysis process?
  • How can integrated sonification and visualization solutions be evaluated?
  • Should integrated contributions be presented at existing visualization venues, sonification venues, or do we need new integrated venues?

I presented a Background on Sonification

I began with some familiar examples, including the Geiger counter, Metal detector and car backing beeper. Next was a historical timeline of key developments, concepts and terms. I then described the established canon of techniques that are now 2 or 3 decades old – audification, parameter mapping, earcons, auditory icons and model-based. I then introduced more recent techniques and concepts – spearcons, stream-based, acoustic, embodied, and podcast. Finally I described the TaDa method for Sonic Information Design which provides a method for choosing a suitable sonification technique based on task analysis and data characteristics. I concluded with the observation that Information Design could provide a unified approach for integrating sonification and visualisation for the purpose of Audiovisual data analysis.