» Articles » PMID: 37869040

Towards a Unified Terminology for Sonification and Visualization

Overview
Date 2023 Oct 23
PMID 37869040
Authors
Affiliations
Soon will be listed here.
Abstract

Both sonification and visualization convey information about data by effectively using our human perceptual system, but their ways to transform the data differ. Over the past 30 years, the sonification community has demanded a holistic perspective on data representation, including audio-visual analysis, several times. A design theory of audio-visual analysis would be a relevant step in this direction. An indispensable foundation for this endeavor is a terminology describing the combined design space. To build a bridge between the domains, we adopt three of the established theoretical constructs from visualization theory for the field of sonification. The three constructs are the , the , and the . In our model, we choose time to be the of sonification. are then positioned in time, such as visual marks are positioned in space. are encoded into auditory marks to convey information. The proposed definitions allow discussing visualization and sonification designs as well as multi-modal designs based on a common terminology. While the identified terminology can support audio-visual analytics research, it also provides a new perspective on sonification theory itself.

Citing Articles

Parallel Chords: an audio-visual analytics design for parallel coordinates.

Elmquist E, Enge K, Rind A, Navarra C, Holdrich R, Iber M Pers Ubiquitous Comput. 2024; 28(5):657-676.

PMID: 39553444 PMC: 11567997. DOI: 10.1007/s00779-024-01795-8.

References
1.
Walker B . Magnitude estimation of conceptual data dimensions for use in sonification. J Exp Psychol Appl. 2003; 8(4):211-21. DOI: 10.1037//1076-898x.8.4.211. View

2.
Nesbitt K, Barrass S . Finding trading patterns in stock market data. IEEE Comput Graph Appl. 2005; 24(5):45-55. DOI: 10.1109/mcg.2004.28. View

3.
Dubus G, Bresin R . A systematic review of mapping strategies for the sonification of physical quantities. PLoS One. 2013; 8(12):e82491. PMC: 3866150. DOI: 10.1371/journal.pone.0082491. View

4.
Satyanarayan A, Moritz D, Wongsuphasawat K, Heer J . Vega-Lite: A Grammar of Interactive Graphics. IEEE Trans Vis Comput Graph. 2016; 23(1):341-350. DOI: 10.1109/TVCG.2016.2599030. View

5.
Handel S . Space is to time as vision is to audition: seductive but misleading. J Exp Psychol Hum Percept Perform. 1988; 14(2):315-7. DOI: 10.1037//0096-1523.14.2.315. View