UNSUPERVISED ANOMALY DETECTION USING SHADOWING OF HUMAN COMPUTER INTERACTION CHANNELS

摘要

Technologies are provided in embodiments to detect anomalies by shadowing human-computer interaction channels. Embodiments include accessing a shadow signal generated by a shadowing device. In an embodiment, the shadow signal can be a video input stream of display screen images rendered on a display screen, where the display screen images were recorded by the shadowing device. The embodiment also includes identifying, at the shadowing device, a first frame of the video input stream, and determining whether an anomaly is associated with the video input stream based, at least in part, on applying a rule of a set of rules to at least a portion of the first frame, where the set of rules defines a control image associated with the video input stream. The embodiment further includes determining whether to take an action based on the determining whether the anomaly is associated with the video input stream.