Interactive multi-channel data sonification to accompany data visualization with partitioned timbre spaces using modulation of timbre as sonification information carriers

摘要

Interactive data sonification for representing multidimensional numerical information with a plurality of variable-timbre channels for use complementing data visualization is described. The method includes generation of a plurality of variable-timbre audio waveforms, each having an audio frequency parameter and at least one timbre modulation parameter having an adjustable value that affects the timbre of the audio waveform. The method includes associating aspects of multidimensional numerical data with the timbre modulation parameter of each audio frequency waveform using a mapping element. The mapping element varies values of timbre modulation parameters responsive to selected values from the multidimensional numerical data. Each audio frequency waveform can be positioned within a sonically-rendered sound field, associating information with positions within the sound field. Mapping elements can vary the positions responsive to selected values from the multidimensional numerical data. In an implementation, a cursor moves over visualized data as associated multidimensional numerical data values are sonified.