Exploiting spatio-temporal characteristics of human vision for mobilevideo applications

摘要

Video applications on handheld devices such as smart phones pose a significant challenge to achieve high quality userexperience. Recent advances in processor and wireless networking technology are producing a new class of multimediaapplications (e.g. video streaming) for mobile handheld devices. These devices are light weight and have modest sizes,and therefore very limited resources — lower processing power, smaller display resolution, lesser memory, and limitedbattery life as compared to desktop and laptop systems. Multimedia applications on the other hand have extensiveprocessing requirements which make the mobile devices extremely resource hungry. In addition, the device specificproperties (e.g. display screen) significantly influence the human perception of multimedia quality. In this paper wepropose a saliency based framework that exploits the structure in content creation as well as the human vision system tofind the salient points in the incoming bitstream and adapt it according to the target device, thus improving the quality ofnew adapted area around salient points. Our experimental results indicate that the adaptation process that is cognizant ofvideo content and user preferences can produce better perceptual quality video for mobile devices. Furthermore, wedemonstrated how such a framework can affect user experience on a handheld device.