首页> 外国专利> Recording medium storing a control program to assist auditory and visual systems and methods to aid in the auditory visually

Recording medium storing a control program to assist auditory and visual systems and methods to aid in the auditory visually

机译:记录介质,该介质存储用于辅助听觉和视觉的控制程序的系统以及在视觉上辅助听觉的方法

摘要

PROBLEM TO BE SOLVED: To automatically synthesize video images for expressing the movement of lips and a sign language with high quality together with voice information and to multi-modally present them. SOLUTION: The video images for which the movement of the lips and the movement of the sign language are photographed beforehand are recorded in a moving picture element piece data base part 4 for each single syllable or word or sentence. Pertinent moving picture element pieces are detected from the moving picture element piece data base part 4 by a moving picture element piece detection part 5 corresponding to a text supplied from a text sentence preparation part 3 and the motion vectors of the video images at the joined parts of the respective moving picture element pieces are detected by a motion vector detection system 6 or the like based on the detected moving picture element pieces. The number of fields interpolated at the joined parts of the respective moving picture element pieces by a field interpolation part and an interpolation position are varied based on the motion vector of the video images and thus, the moving picture element pieces are smoothly joined and synthesized while keeping the flow of the video images natural. Also, synthesized moving images and voice output are synchronized as well.
机译:要解决的问题:自动合成视频图像以高质量地表达嘴唇运动和手语以及语音信息,并以多种方式呈现它们。解决方案:预先拍摄了嘴唇运动和手语运动的视频图像,针对每个单个音节或单词或句子,将其记录在运动图像元数据库部分4中。对应于从文本语句准备部分3提供的文本和在结合部分的视频图像的运动矢量,由运动图像块检测部分5从运动图像块数据库部分4中检测相关的运动图像块。运动矢量检测系统6等基于检测到的运动像素块来检测各个运动像素块中的一个。基于视频图像的运动矢量改变通过场内插部分在各个运动像素块的结合部分处内插的场的数目和内插位置,因此,运动像素块被平滑地结合并合成。保持视频图像的自然流。同样,合成的运动图像和语音输出也同步。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号