METHODS FOR REAL-TIME SKILL ASSESSMENT OF MULTI-STEP TASKS PERFORMED BY HAND MOVEMENTS USING A VIDEO CAMERA

摘要

Example implementations described herein are directed to systems and methods for skill assessment, such as hand washing compliance in hospitals, or assembling products in factories. Example implementations involve body part tracking (e.g., hands), skeleton tracking and deep neural networks to detect and recognize sub-tasks and to assess the skill on each sub-task. Furthermore, the order of the sub-tasks is checked for correctness. Beyond monitoring individual users, example implementations can be used for analyzing and improving workflow designs with multiple sub-tasks.