3D AUDIO AR/VR CAPTURE AND REPRODUCTION SETUP FOR AURALIZATION OF SOUNDSCAPES

摘要

Auralization technique is often used to reproduce sound signals and model acoustic transmission effects in a real environment. This paper describes the construction of an omnidirectional video and ambisonic audio capturing device for Virtual Reality (VR) reproduction, which is intended to be used for auralizing soundscapes. The audio-visual stimulus projected in the VR headset depicts a "360°" scene of a noisy park. The rendering tools and methodology has been described. Different positive soundtracks were analysed and rendered at different spatial locations. An Augmented Reality device (AR) coupled with open back headphones was designed to simulate the masking effects. The aim was to study the effects of varied spatial position of the masker on the static noise source. The devices and tools described can be used in various applications like studying level difference for different types of masking, conducting different types of audio only or audio-visual experiments and for evaluating the effectiveness of placing a virtual sound object in different spatial orientations with respect to the noise source.