Controlled-environment facility video communications monitoring system

摘要

Video communications of residents of a controlled-environment facility are monitored to detect instances of non-verbal communications within the video, such as the display of written messages and hand signals. Residents may participate in live video visitation sessions with non-residents. Video recordings are generated for each video feed of the live video visitation. During the live video visitation, indications of non-verbal communications displayed in the live video are detected. If indications of non-verbal communications are detected in the live video, the recorded video is annotated to specify the locations of the detected indications in the recording. Upon completion of the video visitation session, post-processing of the recorded video detects additional indications of displayed non-verbal communication. The additional indications may be detected at proximal locations to the annotations and may be detected based on sampling frames of the recording to detect changes in the color balance indicating the display of a message surface.