INTERACTIVE, ADAPTIVE, AND MOTIVATIONAL LEARNING SYSTEMS USING FACE TRACKING AND EMOTION DETECTION WITH ASSOCIATED METHODS

摘要

A system for delivering and managing learning and training programmes comprising optical sensors for capturing subject's facial expression, eye movements, point-of-gaze, and head pose of a student subject during a learning session; a domain knowledge data repository comprising concept data entities, each having knowledge and skill content items, and task data entities, each having lecture content material items; a student module configured to estimate the student subject's affective state and cognitive state using the sensory data collected from the optical sensors; and a trainer module configured to select a task data entity for delivery and presentment to the student subject after each completion of a task data entity based on a probability of the student subject's understanding of the associated concept data entity's knowledge and skill content items; wherein the probability of the student subject's understanding is computed using the student subject's estimated affective state and cognitive state.