360 VR SYSTEM AND METHOD FOR PREDICTING USER VIEWPOINT USING LICATION INFORMATION OF SOUND SOURCE IN 360 VR CONTENTS

摘要

Disclosed is a system and method for predicting a user's viewpoint using sound source location information in 360-degree VR content. According to a specific example of the present technology, the existing image MPD is extended to transmit the sound source positioning information (SLI) of the audio MPD, and the region of interest information (ROI), the sound source positioning information (SLI), and the current viewpoint (Viewport) according to the bandwidth situation. Differentiate the weight of each item of Pole, and then multiply by the reference bit rate to determine the next provided segment bit rate and receive the segment with the bandwidth allocated by the determined segment bit rate. Therefore, by using visual and auditory perception, the accuracy of the user's viewpoint position prediction can be improved, and if the user's viewpoint position prediction fails, the user's viewpoint position can be predicted in consideration of the user's current viewpoint. Quality of Experience (QoE) can be guaranteed.