Emotional Status; Evaluation; Gesture Control; Gesture Recognition; Intangible Cultural Heritages; Motion Capturing; Musical Gestures; Musical Instruments; Natural User Interfaces; Sonification; Upper Bodies; User Experience; User Interfaces;

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85087409359&doi=10.1145%2f3127324&partnerID=40&md5=e06b76a3477b4b7b814e58a10d78d970

This article describes a prototype natural user interface, named the Intangible Musical Instrument, which aims to facilitate access to knowledge of performers that constitutes musical Intangible Cultural Heritage using off-the-shelf motion capturing that is easily accessed by the public at large. This prototype is able to capture, model, and recognize musical gestures (upper body including fingers) as well as to sonify them. The emotional status of the performer affects the sound parameters at the synthesis level. Intangible Musical Instrument is able to support both learning and performing/composing by providing to the user not only intuitive gesture control but also a unique user experience. In addition, the first evaluation of the Intangible Musical Instrument is presented, in which all the functionalities of the system are assessed. Overall, the results with respect to this evaluation were very promising.