METHOD AND APPARATUS FOR EFFICIENT DELIVERY AND USAGE OF AUDIO MESSAGES FOR HIGH QUALITY OF EXPERIENCE

摘要

There is provided a system and a method for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree Video environment. In one example, a system is configured to receive at least one Video Stream (106); and receive at least one first Audio Stream (116, 316). The system comprises: at least one media Video decoder (102) configured to decode at least one Video signal from the at least one Video Stream (106) for the representation of a VR, AR, MR or 360-degree Video environment scene (118a) to a user; and at least one media Audio decoder (112) configured to decode at least one Audio signal from the at least one first Audio Stream (116, 316) for the representation of an Audio scene (118b) to the user; a region of interest, ROI, processor (120), configured to: decide, based on the user's current viewport and/or head orientation and/or movement data (122) and/or the metadata, whether an Audio information message associated to the at least one ROI is to be reproduced; and cause, at the decision that the information message is to be reproduced, the reproduction of the Audio information message. There is also provided a system and a method for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree Video environment. In one example, a system is configured to: receive at least one Video Stream (106); and receive at least one first Audio Stream (116, 316). The system comprises: at least one media Video decoder (102) configured to decode at least one Video signal from the at least one Video Stream (106) for the representation of a VR, AR, MR or 360-degree Video environment scene (118a) to a user; and at least one media Audio decoder (112) configured to decode at least one Audio signal from the at least one first Audio Stream (116, 316) for the representation of an Audio scene (118b) to a user; a region of interest, ROI, processor (120), configured to decide, based on the user's current viewport and/or position and/or head orientation and/or movement data (122) and/or metadata (141) and/or other criteria, whether an Audio information message associated to the at least one ROI is to be reproduced; and a metadata processor (132) configured to receive and/or process and/or manipulate metadata (141) so as to cause, at the decision that the information message is to be reproduced, the reproduction of the Audio information message according to the metadata (141).