A system for automatic animation of piano performances†

摘要

Playing the piano requires one to precisely position one’s hand in order to strike particular combinations of keys at specificnmoments in time. This paper presents the first system for automatically generating three-dimensional animations of pianonperformance, given an input midi music file. A graph theory-based motion planning method is used to decide which set ofnfingers should strike the piano keys for each chord. As the progression of the music is anticipated, the positions of unusednfingers are calculated to make possible efficient fingering of future notes. Initial key poses of the hands, including those forncomplex piano techniques such as crossovers and arpeggio, are determined on the basis of the finger positions and pianontheory. An optimization method is used to refine these poses, producing a natural and minimal energy pose sequence.nMotion transitions between poses are generated using a combination of sampled piano playing motion and music features,nallowing the system to support different playing styles. Our approach is validated through direct comparison with actualnpiano playing and simulation of a complete music piece requiring various playing skills. Extensions of our system arendiscussed. Copyright © 2012 John Wiley & Sons, Ltd.