A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2013 Dec 21

PMID 24358192

Citations 36

Authors

Gael Dubus

Roberto Bresin

Affiliations

Soon will be listed here.

Abstract

The field of sonification has progressed greatly over the past twenty years and currently constitutes an established area of research. This article aims at exploiting and organizing the knowledge accumulated in previous experimental studies to build a foundation for future sonification works. A systematic review of these studies may reveal trends in sonification design, and therefore support the development of design guidelines. To this end, we have reviewed and analyzed 179 scientific publications related to sonification of physical quantities. Using a bottom-up approach, we set up a list of conceptual dimensions belonging to both physical and auditory domains. Mappings used in the reviewed works were identified, forming a database of 495 entries. Frequency of use was analyzed among these conceptual dimensions as well as higher-level categories. Results confirm two hypotheses formulated in a preliminary study: pitch is by far the most used auditory dimension in sonification applications, and spatial auditory dimensions are almost exclusively used to sonify kinematic quantities. To detect successful as well as unsuccessful sonification strategies, assessment of mapping efficiency conducted in the reviewed works was considered. Results show that a proper evaluation of sonification mappings is performed only in a marginal proportion of publications. Additional aspects of the publication database were investigated: historical distribution of sonification works is presented, projects are classified according to their primary function, and the sonic material used in the auditory display is discussed. Finally, a mapping-based approach for characterizing sonification is proposed.

Citing Articles

A review of concurrent sonified biofeedback in balance and gait training.

Zaferiou A, Hirsch Z, Bacani T, Dahl L J Neuroeng Rehabil. 2025; 22(1):38.

PMID: 40011952 PMC: 11866693. DOI: 10.1186/s12984-025-01565-4.

Parallel Chords: an audio-visual analytics design for parallel coordinates.

Elmquist E, Enge K, Rind A, Navarra C, Holdrich R, Iber M Pers Ubiquitous Comput. 2024; 28(5):657-676.

PMID: 39553444 PMC: 11567997. DOI: 10.1007/s00779-024-01795-8.

Enhancing Perceptual-Motor Skills in Sports: The Role of Ecological Sounds.

Agostini T, Sors F, Murgia M, Galmonte A J Intell. 2024; 12(2).

PMID: 38392171 PMC: 10889727. DOI: 10.3390/jintelligence12020015.

Sonification for Personalised Gait Intervention.

Wall C, McMeekin P, Walker R, Hetherington V, Graham L, Godfrey A Sensors (Basel). 2024; 24(1).

PMID: 38202926 PMC: 10780936. DOI: 10.3390/s24010065.

Movement Sonification Techniques to Improve Balance in Parkinson's Disease: A Pilot Randomized Controlled Trial.

Raglio A, De Maria B, Parati M, Giglietti A, Premoli S, Salvaderi S Brain Sci. 2023; 13(11).

PMID: 38002546 PMC: 10670131. DOI: 10.3390/brainsci13111586.

References

Eriksson M, Halvorsen K, Gullstrand L . Immediate effect of visual and auditory feedback to control the running mechanics of well-trained athletes. J Sports Sci. 2010; 29(3):253-62. DOI: 10.1080/02640414.2010.523088. View

Huang H, Wolf S, He J . Recent developments in biofeedback for neuromotor rehabilitation. J Neuroeng Rehabil. 2006; 3:11. PMC: 1550406. DOI: 10.1186/1743-0003-3-11. View

Dozza M, Chiari L, Chan B, Rocchi L, Horak F, Cappello A . Influence of a portable audio-biofeedback device on structural properties of postural sway. J Neuroeng Rehabil. 2005; 2:13. PMC: 1183240. DOI: 10.1186/1743-0003-2-13. View

Scheef L, Boecker H, Daamen M, Fehse U, Landsberg M, Granath D . Multimodal motion processing in area V5/MT: evidence from an artificial class of audio-visual events. Brain Res. 2008; 1252:94-104. DOI: 10.1016/j.brainres.2008.10.067. View

Huang H, Ingalls T, Olson L, Ganley K, Rikakis T, He J . Interactive multimodal biofeedback for task-oriented neural rehabilitation. Conf Proc IEEE Eng Med Biol Soc. 2007; 2005:2547-50. DOI: 10.1109/IEMBS.2005.1616988. View

Hinterberger T, Neumann N, Pham M, Kubler A, Grether A, Hofmayer N . A multimodal brain-based feedback and communication system. Exp Brain Res. 2003; 154(4):521-6. DOI: 10.1007/s00221-003-1690-3. View

Mansur D, Blattner M, Joy K . Sound graphs: a numerical data analysis method for the blind. J Med Syst. 1985; 9(3):163-74. DOI: 10.1007/BF00996201. View

Chiari L, Dozza M, Cappello A, Horak F, Macellari V, Giansanti D . Audio-biofeedback for balance improvement: an accelerometry-based system. IEEE Trans Biomed Eng. 2005; 52(12):2108-11. DOI: 10.1109/TBME.2005.857673. View

Watson M, Sanderson P . Designing for attention with sound: challenges and extensions to ecological interface design. Hum Factors. 2007; 49(2):331-46. DOI: 10.1518/001872007X312531. View

10.

Walker B . Magnitude estimation of conceptual data dimensions for use in sonification. J Exp Psychol Appl. 2003; 8(4):211-21. DOI: 10.1037//1076-898x.8.4.211. View

11.

Ahmad A, Adie S, Wang M, Boppart S . Sonification of optical coherence tomography data and images. Opt Express. 2010; 18(10):9934-44. PMC: 3308194. DOI: 10.1364/OE.18.009934. View

12.

Jovanov E, Wegner K, Radivojevic V, Starcevic D, Quinn M, Karron D . Tactical audio and acoustic rendering in biomedical applications. IEEE Trans Inf Technol Biomed. 2000; 3(2):109-18. DOI: 10.1109/4233.767086. View

13.

Giansanti D, Dozza M, Chiari L, Maccioni G, Cappello A . Energetic assessment of trunk postural modifications induced by a wearable audio-biofeedback system. Med Eng Phys. 2008; 31(1):48-54. DOI: 10.1016/j.medengphy.2008.04.004. View

14.

Jovanov E, Starcevic D, Radivojevic V, Samardzic A, Simeunovic V . Perceptualization of biomedical data. An experimental environment for visualization and sonification of brain electrical activity. IEEE Eng Med Biol Mag. 1999; 18(1):50-5. DOI: 10.1109/51.740964. View

15.

Sigrist R, Rauter G, Riener R, Wolf P . Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychon Bull Rev. 2012; 20(1):21-53. DOI: 10.3758/s13423-012-0333-8. View

16.

Dozza M, Chiari L, Horak F . Audio-biofeedback improves balance in patients with bilateral vestibular loss. Arch Phys Med Rehabil. 2005; 86(7):1401-3. DOI: 10.1016/j.apmr.2004.12.036. View

17.

Walker B, Lindsay J, Nance A, Nakano Y, Palladino D, Dingler T . Spearcons (speech-based earcons) improve navigation performance in advanced auditory menus. Hum Factors. 2013; 55(1):157-82. DOI: 10.1177/0018720812450587. View

18.

Watson M, Sanderson P . Sonification supports eyes-free respiratory monitoring and task time-sharing. Hum Factors. 2004; 46(3):497-517. DOI: 10.1518/hfes.46.3.497.50401. View

19.

Krishnan S, Rangayyan R, Bell G, Frank C . Auditory display of knee-joint vibration signals. J Acoust Soc Am. 2002; 110(6):3292-304. DOI: 10.1121/1.1413995. View

20.

Baier G, Hermann T, Stephani U . Event-based sonification of EEG rhythms in real time. Clin Neurophysiol. 2007; 118(6):1377-86. DOI: 10.1016/j.clinph.2007.01.025. View