Synaesthesia and Cross-Modality in Contemporary Audiovisuals
Abstract
In experimental electronic music, and beyond, audiovisual practice is proliferating. In particular, the ideal of tightly coupled or synaesthetic audiovisuals has a renewed cultural currency, and is manifest across popular and experimental domains. Automated techniques such as analysis-driven visualisation, and more direct transcodings, seem synaesthetic in their literal cross-wiring of one mode with another. In this paper I will pursue the notion of synaesthetic media by setting this practice and its techniques against neurological theories of synaesthetic experience. Does this work seek to induce, simulate, or perhaps teach, synaesthetic perception? If so, are there contemporary cultural conditions that underpin that aim, or is this work simply a continuation of the long tradition of “visual music”? As a counterpoint, an approach based on theories of cross-modal perception is proposed. Audiovisual work emphasises a process of perceptual binding - the formation of correlations between elements in the sensory field. Bindings across sensory modalities are powerful and readily formed, but also commonplace, unlike synaesthesia. Science suggests that such cross-modal correlations are crucially useful in perceiving our environment and identifying a single underlying source or object. Yet if audiovisuals offer us objects for cross-modally bound perception, what is the underlying object that they, or we, infer? Is it the source data or signal - the sound being visualised, or the video being sonified; or is it in fact the map, the structure of the transformation between modalities? Pursuing these questions positions contemporary audiovisuals within a broader context of new media practice, and suggests that their significance lies partly in their ability to feel out the abstract forms that underpin digital culture.
How to cite
Mitchell Whitelaw. 2006. “Synaesthesia and Cross-Modality in Contemporary Audiovisuals.” In Proceedings of the Australasian Computer Music Conference 2006, edited by Sonia Wilkie and Christian Haines. Adelaide, Elder Conservatorium of Music: Australasian Computer Music Association. https://computermusic.org.au/proceedings/ACMC2006-proceedings/whitelaw-synaesthesia-cross-modality.html
BibTeX
@inproceedings{whitelaw2006synaesthesia,
author = {Mitchell Whitelaw},
title = {{Synaesthesia and Cross-Modality in Contemporary Audiovisuals}},
booktitle = {Proceedings of the Australasian Computer Music Conference 2006},
editor = {Sonia Wilkie and Christian Haines},
year = {2006},
publisher = {Australasian Computer Music Association},
address = {Adelaide, Elder Conservatorium of Music},
issn = {1448-7780},
url = {https://computermusic.org.au/proceedings/ACMC2006-proceedings/ACMC06-Paper-Whitelaw.pdf}
}