8K/16K Video and 3D Audio Coding and Playback for Large-Screen Immersive Spaces

摘要

In this paper, we present a set of tools designed to simplify the distribution, playback, and adaptation of high-quality immersive content for large-screen immersive environments. The tools are based on a high-performance high-efficiency video coding (HEVC) codec that allows one to encode, decode, and play ultrahigh-resolution video in 8K and 16K resolutions using standard computing systems. A flexible video-rendering engine allows the content to be adapted to different output display environments. In addition, an immersive audio workflow, based on high-order ambisonics, provides support for 3D and interactive audio. The new tools have been validated in two advanced immersive installations using new immersive content created using various techniques that has been produced in the context of the Immersify European Project. The results show that the new tools enable ultrahigh-resolution immersive video playback combined with 3D audio, and first evaluations indicate that a better immersive experience for final users can be achieved, while at the same time using a simpler workflow.