Device and Method for Capturing Vocal Sound and Mouth Region Images

摘要

A device suitable for use in various applications, including, for example, sound production applications and video game applications. In one non-limiting embodiment, the device comprises a sound capturing unit for generating a first signal indicative of vocal sound produced by a user and an image capturing unit for generating a second signal indicative of images of a mouth region of the user. The device also comprises a processing unit communicatively coupled to the sound capturing unit and the image capturing unit for processing the first signal and the second signal. In an example in which the device is used for sound production, the processing unit is operative for processing the first signal and the second signal to cause a sound production unit to emit sound audibly perceivable as being a modified version of the vocal sound produced by the user. In an example in which the device is used for playing a video game, the processing unit is operative for processing the second signal to generate a video game feature control signal for controlling a feature associated with the video game. The feature associated with the video game may be a virtual character of the video game. The processing unit is further operative for processing the first signal for causing a sound production unit to emit sound associated with the video game.