Real-time video coding system for up to 4K 120P videos with spatio-temporal format conversion

摘要

A prototype UHDTV video coding system with spatio-temporal down-/up-sampling is proposed. The system prereduces the spatial resolutions and/or frame rates of source UHDTV videos to 2K 60P before being encoded by a standardized codec such as HEVC/H.265. On the reception side, the decoded video is up-sampled to 4K 120P, 4K 60P, or 2K 120P resolutions depending on the specifications of the displays. We developed a real-time spatio-temporal format converter with single-/multi-frame hybrid super resolution up-samplers, and we tested the performance in combination with a 2K 60P HEVC/H.265 encoder. The hardware implementations and the experiments with 4K 120P video coding are shown in this paper.