RIMS: A Real-time and Intelligent Monitoring System for live-broadcasting platforms

摘要

Personal live shows on Internet streaming platforms currently are blooming as one of the most popular applications on mobile phones and especially attracting millions of young generation users. The content supervision on live streaming platforms, in which there are thousands or hundreds of show rooms for performing and chatting synchronously, is a major concern with the development of this new service. Traditional image captures and real-time content analysis experience huge difficulties such as processing delay, data overwhelming, and matching overhead. In this paper, we propose a comprehensive method to monitor real-time live stream and to identify illegal or unchartered live misbehaviors intelligently based on various proposed aspects instead of image analysis only. The proposed system called RIMS makes use of several novel indicators on show room status rather than analyzing images solely to support real-time requirements. Three detecting techniques are adopted: self-adaptive threshold-based abnormal traffic detection, sensitive Danmaku comment perception, and frame difference analysis. RIMS can detect dramatically increasing of user number in a show room, filter sensitive words in Danmaku, and capture segmentation of video scenes by frame difference analysis. We deploy our system to monitor a typical live-broadcasting platform called panda.tv, and overall accuracy of detection via three indicators reaches 90.1%. The application of RIMS can change current supervison methods on live platforms that they totally rely on real-time manual review or after the event check. The key techniques in RIMS can also be widely employed in many other mobile applications in edge computing such as video surveillance in Internet of Things and mobile short video sharing. (C) 2018 Elsevier B.V. All rights reserved.