首页> 外国专利> Method and system for incorporating contextual and emotional visualization into electronic communications

Method and system for incorporating contextual and emotional visualization into electronic communications

机译:用于将情境和情感可视化结合到电子通信中的方法和系统

摘要

A computer-implemented method and system for incorporating emotional and contextual visualization into an electronic communication, comprises: creating a 2D texture map of a user's face from a series of photos; comparing user's 2D texture map with 2D texture maps of the samples from a reference database to find the closest matches and create a photorealistic composite 3D mesh model of the user's head that can be modified to present different emotions and phonemes; during an electronic communication between a sending device of the user and the receive device, determining an emotional state and a current phoneme (viseme) through user's voice, text or data from the camera and transmitting an emotional identifier and a phoneme identifier to the receiving devise; using emotion ID and phoneme ID to retrieve from the databases, loaded on receiving device, corresponding 3D mesh models and corresponding 2D textures to create and display a fully animated video message on the receiving devise without requiring video data transmission via the communication channel.
机译:一种用于将情感和情境可视化结合到电子通信中的计算机实现的方法和系统,包括:从一系列照片创建用户面部的2D纹理图;将用户的2D纹理图与参考数据库中样本的2D纹理图进行比较,以找到最接近的匹配项,并创建用户头部的真实感复合3D网格模型,可以对其进行修改以呈现不同的情感和音素;在用户的发送设备和接收设备之间的电子通信期间,通过用户的声音,文本或来自摄像头的数据确定情绪状态和当前音素(viseme),并将情绪标识符和音素标识符传输到接收设备;使用情感ID和音素ID从数据库中检索,加载到接收设备上,相应的3D网格模型和相应的2D纹理,以在接收设备上创建并显示完整动画的视频消息,而无需通过通信通道传输视频数据。

著录项

  • 公开/公告号US10528801B2

    专利类型

  • 公开/公告日2020-01-07

    原文格式PDF

  • 申请/专利权人 KEYTERRA LLC;

    申请/专利号US201715834999

  • 发明设计人 LEONID ARBATMAN;VIACHESLAV IUSHCHENKO;

    申请日2017-12-07

  • 分类号G06K9;G06T13/80;G06T13/40;G06T17/20;H04L12/58;H04L12/18;

  • 国家 US

  • 入库时间 2022-08-21 11:19:06

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号