Distortions in QoE Measurements of Ubiquitous Mobile Video Services Caused by the Preconceptions of Test Subjects

摘要

In telecommunication services, alongside QoS, QoE provision has become essential, thus performance and quality evaluation measurement results need to reflect reality as much as possible. Our goal is to enhance QoE evaluation schemes and enable improved QoE provision for video applications and services anytime and anywhere. In order to eliminate potential erroneous conclusions of QoE assessment techniques, our paper reveals a novel topic of distortions caused by preconceptions based on prior technical knowledge of QoE measurement test subjects. In our analysis we introduce the differences from genuine QoE measurement results in 3G ubiquitous mobile video service scenarios where test subjects were aware of the service parameters during measurements. We show how subjects' evaluations were affected and investigate the identified phenomenon in terms of Mean Opinion Score deviations and the overall QoE result distortion.