Synesthesia audio-visual interactive-sound and music visualization in virtual reality with orbital observation and navigation

摘要

Music visualization is particularly suited to enjoying music and for new modes of interaction and embodiment in virtual reality. Here I demonstrate several real-time virtual reality sound and music visualization techniques and applications using both music from electronic music producer James Le Roux, and sound from a user's microphone. Additionally, the adoption of an `orbital mode' interaction technique allows unprecedented hands-free user observation and navigation control. Users are able to pause the sound, halting the visualization data so that it can be viewed in freeze-frame from any angle.