Skeleton-based automatic generation of Labanotation with neural networks

摘要

Labanotation is one of the most widely used notation systems and plays a powerful role in recording and archiving traditional folk dance. We propose an end-to-end method for generating Labanotation from motion capture data by identifying the movement of each part of the human body and by assigning corresponding Labanotation symbols. Our method is mainly highlighted in the following aspects: first, we design simple yet highly discriminative skeleton features that can accurately represent human movements; and second, for the recognition of upper limb movements, we adopt fast and efficient extreme-learning neural networks, and for the recognition of lower limb movements, we employ powerful long short-term memory networks. It is worth mentioning that this is the first time that neural networks have been applied to the field of Labanotation generation. Experimental results show that our approach achieves much better recognition accuracy than previous work. (C) 2019 SPIE and IS&T