APPLYING MULTI-CHANNEL COMMUNICATION METRICS AND SEMANTIC ANALYSIS TO HUMAN INTERACTION DATA EXTRACTION

摘要

A method and system for in-depth person interaction analysis and data extraction, applicable to digitally captured social communication and/or human—machine interaction. The method can include: capturing media data over multiple channels (video, audio, spatial, health, etc.); capturing interaction's related artifacts (e.g., presentation slides, screen capture); enriching the collected data with data from non-interaction data sources (e.g. social media); extracting communication metrics from the captured media data; building a comprehensive sentiment perception product that is a time-based derivative of sentiment expressions based at least in part on a combination of the communication metrics; providing communication analysis result that is based at least in part on the sentiment perception product; enriching communication analysis result by cross-mapping sentiment perception product to semantically meaningful time segments of an interaction identified by analyzing media data and interaction's artifacts.