Element contents
Hidden Music
The Composer's Guide to Sonification
Published online by Cambridge University Press: 16 January 2025
Summary
This book explores the intersection of data sonification (the systematic translation of data into sound) and musical composition. Section 1 engages with existing discourse and offers an original model (the sonification continuum) which provides perspectives on the practice of sonification for composers, science communicators and those interested in this rapidly emerging field. Section 2 engages with the sonification process itself, exploring techniques, models of translation, data fidelity, analogic and symbolic data mapping, temporality and the listener experience. In Section 3 these concepts and techniques are all made concrete in the context of a selection of the author's projects (2004–2023). Finally, some reasons are offered on how sonification as a practice might enrich composition, communication, collaboration, and a sense of connection.
- Type
- Element
- Information
- Online ISBN: 9781009258555Publisher: Cambridge University PressPrint publication: 30 January 2025
References
Atasoy, S., Donnelly, I. & Pearson, J. (2016). Human brain networks function in connectome-specific harmonic waves. Nature Communications 7: 10340. DOI: https://doi.org/10.1038/ncomms10340.CrossRefGoogle ScholarPubMed
Barrass, S. & Vickers, P. (2011). Sonification design and aesthetics, in Hermann, T., Hunt, A. & Neuhoff, J. G., eds. The Sonification Handbook: 145–171. Logos Publishing House.Google Scholar
Bastan, D. (2022). Inspired by Nature. Ableton Live Pack, www.ableton.com/en/packs/inspired-nature/.Google Scholar
Baxter, I. (2020). Sonification as a means to generative music, PhD thesis, University of Sheffield. https://etheses.whiterose.ac.uk/27591/.Google Scholar
Brazil, E. & Fernström, M. (2011). Auditory icons, in Hermann, T., Hunt, A. & Neuhoff, J. G., eds. The Sonification Handbook: 325–335. Logos Publishing House.Google Scholar
Buckle, B. (2022). Spectrogram art: A short history of musicians hiding visuals inside their tracks, https://mixmag.net/feature/spectrogram-art-music-aphex-twin.Google Scholar
Code, D. L. (2023). Can musical encryption be both? A survey of music-based ciphers. Cryptologia, 47(4): 318–364, DOI: https://doi.org/10.1080/01611194.2021.2021565.CrossRefGoogle Scholar
Danielsen, A. (Ed.). (2010). Musical Rhythm in the Age of Digital Reproduction (1st ed.). Routledge.Google Scholar
Dombois, F. & Eckel, G. (2011). Audification, in Hermann, T., Hunt, A., & Neuhoff, J. G., eds. The Sonification Handbook: 301–320. Logos Publishing House.Google Scholar
Durbin, R., Eddy, S., Krogh, A. & Mitchison, G. (1998). Biological Sequence Analysis. Cambridge University Press.CrossRefGoogle Scholar
Enyart, J. W. (1984). The symphonies of Heitor Villa-Lobos. PhD dissertation. University of Cincinnati.Google Scholar
Fabian, D., Timmers, R. & Schubert, E. (Eds.). (2014). Expressiveness in Music Performance: Empirical Approaches across Styles and Cultures (1st ed.). Oxford University Press.CrossRefGoogle Scholar
Glennie, E. (2018). The Rhythm of Life. BBC Radio 4. www.bbc.co.uk/programmes/b0bgfqx7.Google Scholar
Gresham-Lancaster, S. (2012). Relationships of sonification to music and sound art. AI & Society, 27(2): 207–212.CrossRefGoogle Scholar
Grond, F. & Berger, J. (2011). Parameter mapping sonification, in Hermann, T., Hunt, A., & Neuhoff, J. G., eds., The Sonification Handbook, chapter 15: 363–397. Logos Publishing House.Google Scholar
Hermann, T. (2010). Sonification: A Definition. http://sonification.de/son/definition.Google Scholar
Hermann, T., Hunt, A. & Neuhoff, J. G., eds. (2011). The Sonification Handbook. Logos Publishing House.Google Scholar
Exit, Hey (2015). Every Recording of Gymnopédie 1. https://soundcloud.com/hey-exit/every-recording-of-gymnopedie-1.Google Scholar
Holmes, T. (2020). Electronic and Experimental Music: Technology, Music, and Culture (6th ed.). Routledge.CrossRefGoogle Scholar
Huron, D. (2008). Sweet Anticipation: Music and the Psychology of Expectation. Massachusetts Institute of Technology Press.Google Scholar
Huss, M. (2024) ‘Unforgotten grooves: Reading and Listening to Rainer Maria Rilke’s Primal Sound’ in Groth, S. K. & Frisk, H., eds (2024) Traces of Sound: Reflections of Sounds Unheard (2024): 37–50. Lund: The Sound Environment Centre at Lund University.Google Scholar
ITU (2009). International Morse Code Recommendation. Radiocommunication Sector. Itu.int (Report). ITU Recommendation. International Telecommunication Union. October. ITU-R M.1677-1.Google Scholar
Juslin, P. N. (2013). From everyday emotions to aesthetic emotions: Towards a unified theory of musical emotions. Physics of Life Reviews, 10(3): 235–266.CrossRefGoogle ScholarPubMed
Kepler, J., Aiton, E. J., Duncan, A. M. & Field, J. V. (1997). The Harmony of the World. American Philosophical Society.Google Scholar
Kramer, G. (1994). An introduction to auditory display. In Kramer, G. (Ed.), Auditory display: Sonification, audification, and auditory interfaces (pp. 1–78). Reading, MA: Addison Wesley.Google Scholar
Kramer, G., Walker, B., Bonebright, T., Cook, P., Flowers, J. H., Miner, N. & Neuhoff, J. (1999). Sonification report: Status of the field and research agenda prepared for the National Science Foundation by Members of the International Community for Auditory Display [White paper]. http://sonify.psych.gatech.edu/publications/pdfs/1999-NSF-Report.pdf.Google Scholar
Langton, J. (2020). Systems, objects and space in the work of Beatriz Ferreyra, Delia Derbyshire, Éliane Radigue and Teresa Rampazzi. PhD Thesis. University of Surrey.Google Scholar
Lehman, F. (2013). Transformational analysis and the representation of genius in film music. Music Theory Spectrum, 35(1): 1–22.CrossRefGoogle Scholar
Lewand, R. (2000). Cryptological Mathematics. Mathematical Association of America.CrossRefGoogle Scholar
London, J. (2012). Hearing in Time: Psychological Aspects of Musical Meter (2nd ed). Oxford University Press.CrossRefGoogle Scholar
Mayo, N. (1997). Ocean waves: Their energy and power’, Physics Teacher, 35: 352–356.CrossRefGoogle Scholar
Mermikides, M. (2010). Changes over time: Theory & practice. PhD Thesis. University of Surrey.Google Scholar
Mermikides, M. (2020a). ‘Straight and Late’: Analytical perspectives on Coltrane’s time-feel, Jazz Perspectives, 12(1): 147–166.CrossRefGoogle Scholar
Mermikides, M. (2020b). Two Blue Circles for Classical Guitar and Electronics. Viribus.Google Scholar
Mermikides, M. (2022a). Diamonds, abaci, and hexagrams: Exploring the pitch surface of the guitar fretboard. Soundboard Scholar, vol. 8. https://digitalcommons.du.edu/sbs/vol8/iss1/17/.CrossRefGoogle Scholar
Mermikides, M. (2022b). The Modal Compass: 3 Ways to Navigate the Modes. https://youtu.be/eMHRCfeozVo.Google Scholar
Mermikides, M. & Feygelson, E. (2017). The shape of musical improvisation, in Leech-Wilkinson, D. l. & Prior, H. M., eds., Music and Shape, vol. 1: 170–204. Oxford University Press.Google Scholar
Mermikides, M., Zinovieff, P. & Curran-Cundy, A. (2020). Revisiting December Hollow: Unearthing emotive shape, in Weinel, J., Bowen, J. P., Diprose, G. & Lamport, N., eds., Proceedings of EVA London 2020 (EVA 2020), BCS. DOI: https://doi.org//10.14236/ewic/EVA2020.16.Google Scholar
Millar, J. & Cage, J. (2010). Every Day Is a Good Day: The Visual Art of John Cage. Hayward Publishing.Google Scholar
Mitchell, J. (1994). Joni Mitchell: The Magdalene Laundries (Live Toronto 1994). www.youtube.com/watch?v=ATaFyIbd5hY.Google Scholar
National Center for Biotechnology Information (2023). SARS-CoV-2 Data Hub. www.ncbi.nlm.nih.gov/sars-cov-2/.Google Scholar
National Institute of Standards and Technology (2010). STR Fact Sheet. https://strbase.nist.gov/str_VWA.htm.Google Scholar
Neuhoff, J. G. (2019). Is sonification doomed to fail? Proceedings of the 25th International Conference on Auditory Display (ICAD). DOI: https://doi.org/10.21785/icad2019.069.CrossRefGoogle Scholar
New Scientist (2021). Escape Pod: #3 Music: The jazz swing of birdsong and the sonification of the orbits of planets. https://podbay.fm/p/new-scientist-escape-pod/e/1612281600.Google Scholar
Potter, G. D. M., Skene, D. J., Arendt, J., Cade, J. E., Grant, P. J. & Hardie, L. J. (2016). Circadian rhythm and sleep disruption: Causes, metabolic consequences, and countermeasures. Endocrine Reviews, 37(6): 584–608.CrossRefGoogle ScholarPubMed
Rilke, R. M. (1919), ‘Ur-Geräusch’, Das Inselschiff: Eine zweitmonatsschrift 1(1), 14–20.Google Scholar
Robilliard, J. J., Thilo., P. & Wilson, A. M. (2006). Gait characterisation and classification in horses. Journal of Experimental Biology, 210(2): 187–197.CrossRefGoogle Scholar
Sams, E. (1980). Cryptography, musical, in Sadie, S. (ed.), The New Grove Dictionary of Music and Musicians. DOI: https://doi.org/10.1093/gmo/9781561592630.article.06915.CrossRefGoogle Scholar
Sapir, E. (2014) Language: an introduction to the study of speech. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Sawe, N., & Chafe, C. & Treviño, J. (2020). Using data sonification to overcome science literacy, numeracy, and visualization barriers in science communication. Frontiers in Communication, 5. DOI: htttps://doi.org/10.3389/fcomm.2020.00046.Google Scholar
Scaletti, C. (2021). Sonification ≠ Music, in McLean, A. and Dean, R. T. (2021) The Oxford Handbook of Algorithmic Music. New York: Oxford University Press: 376–385.Google Scholar
Schedel, M. (2021). Color is the keyboard: Transcoding from visual to sonic, in McLean, A. and Dean, R. T. (2021) The Oxford Handbook of Algorithmic Music. New York: Oxford University Press: 387–422.Google Scholar
Scholz, D. S., Rohde, S., Nikmaram, N., Brückner, H. P., Großbach, M., Rollnik, J. D., & Altenmüller, E. O. (2016). Sonification of arm movements in stroke rehabilitation: A novel approach in neurologic music therapy. Frontiers in Neurology, 7: 106.CrossRefGoogle ScholarPubMed
Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27: 379–423, 623–656.CrossRefGoogle Scholar
Sorensen, N. (2010). Harvard Natural Sciences Lecture Demonstration: Pendulum Waves. https://www.youtube.com/watch?v=yVkdfJ9PkRQ.Google Scholar
Stark, E. A., Vuust, P. and Kringelbach, M. L. (2018). Music, dance, and other art forms: New insights into the links between hedonia (pleasure) and eudaimonia (well-being), in Progress in Brain Research. Elsevier: 129–152.Google Scholar
Stevner, A. B. A., Vidaurre, D., Cabral, J., Rapuano, K., Nielsen, S. F. V., Tagliazucchi, E., Laufs, H., Vuust, P., Deco, G., Woolrich, M. W., Van Someren, E., & Kringelbach, M. L. (2019). Discovery of key whole-brain transitions and dynamics during human wakefulness and non-REM sleep. Nature Communications, 10(1): 1035.CrossRefGoogle ScholarPubMed
Supper, A. (2012). The Search for the ‘killer application’: Drawing the boundaries around the sonification of scientific data. In Pinch, T. & Bijstervel, K. eds.,The Oxford Handbook of Sound Studies. Oxford University Press: 249–270.Google Scholar
Supper, A. (2016). Lobbying for the ear, listening with the whole body: The (anti-)visual culture of sonification, Sound Studies, 2(1): 69–80.CrossRefGoogle Scholar
Tanczos, A. (2014). Villa-Lobos’s New York Skyline Melody Visualisation. https://www.youtube.com/watch?v=TiF80x7KfC8Google Scholar
Tufte, E. R. (2001). The Visual Display of Quantitative Information. 2nd ed. Cheshire, CT: Graphics Press.Google Scholar
Tymoczko, D. (2011). A Geometry of Music: Harmony and Counterpoint in the Extended Common Practice. Oxford University Press.Google Scholar
Vickers, P. (2016). Sonification and music, music and sonification, in The Routledge Companion to Sounding Art. Routledge, London: 135–144.Google Scholar
Wishart, T., & Emmerson, S. (1996). On Sonic Art. Harwood Academic Publishers.CrossRefGoogle Scholar
Worrall, D. (2009). Sonification and Information: Concepts, instruments and techniques. University of Canberra.
Google Scholar
Worrall, D. (2011). An introduction to data sonification, in Dean, R. T., ed., The Oxford Handbook of Computer Music. Oxford: Oxford University Press: 312–333.Google Scholar
Zinovieff, P. (1969). The special case of inspiration computer music scores. London Magazine, 100: 165–176.Google Scholar