System and Method for Modulating a Peripheral Device Based on an Unscripted Feed Using Computer Vision

摘要

A system for processing at least one of an audio or video input for non-scripted modulation of at least one peripheral device, comprising: the at least one peripheral device in physical contact with at least one user or free from the at least one user and in communication with at least a first device playing at least one of an original programming feed or live feed unscripted with modulation triggers; a processor; a memory element coupled to the processor; a program executable by the processor to: recognize at least one of the audio or video input from the at least one of the original programming feed or live feed, and determine for at least one tagged event, at least one of a pixel color score, a pixel velocity score, an event proximity score or an audio score; and convert the at least one scored event into at least one of an output command that triggers or controls a modulation effect of the at least one peripheral device in physical contact or free from the user in communication with the at least the first device playing the at least one of the original programming feed or live feed, thereby enabling modulation of the at least one peripheral device based on any programming comprising at least one of an audio or video input and not requiring scripted modulation triggers.