Recognition system using multimodality dataset

摘要

A computer system extracts motion features from a video recording of a real-world event, captured from a video recording device, to generate a motion capture dataset, the motion capture dataset including human models of human motion; generates a synthetic dataset based on derivatives of the motion capture dataset; generates an augmented motion capture dataset based on modified conditions of the motion capture dataset; generates an augmented synthetic dataset based on modified conditions of the synthetic dataset; and generates a multimodality dataset based on a combination of the motion capture dataset, the synthetic dataset, the augmented motion capture dataset, and the augmented synthetic dataset.