2 3 3 / Method for realtime processing image/sound of 2D/3D image and 3D sound in multimedia content

摘要

PURPOSE: A method for processing video and audio of two and three dimensional video and three dimensional audio in multimedia contents in real time is provided to generate a moving sound and a location sound based on location information of a character, when moving the character in three dimensional video at random, so as to implement three dimensional audio in all direction of a user. CONSTITUTION: Two and three dimensional video and wave data are generated. Names of wave data to be synchronized with a character is loaded, and IDs are assigned to each wave data name(S1,S2). Location information of the character is inputted(S3). Whether the location information of the character is changed is checked(S4). If not changed, a location sound is generated using the location information and an HRTF(Head Related Transfer Function) DB value(S5-S8). If changed in the step of S4, a natural moving sound is generated using the location information of the moved character, the HRTF DB value and HRTF interpolation(S9-S15). A predetermined size of wave data are loaded(S16). The loaded wave data and the location or moving sound are convoluted and converted into complete three dimensional audio(S17). The three dimensional audio is output through a speaker(S18). Whether last wave data are generated is checked, if so, the steps are ended, and if not, the step of S4 is returned(S19).