Recognizing solo jazz dance moves using a single leg-attached inertial wearable device

Stančin, Sara (author), Tomažič, Sašo (author)

We present here a method for recognising dance moves in sequences using 3D accelerometer and gyroscope signals, acquired by a single wearable device, attached to the dancer’s leg. The recognition entails dance tempo estimation, temporal scaling, a wearable device orientation-invariant coordinate system transformation, and, finally, sliding correlation-based template matching. The recognition is independent of the orientation of the wearable device and the tempo of dancing, which promotes the usability of the method in a wide range of everyday application scenarios. For experimental validation, we considered the versatile repertoire of solo jazz dance moves. We created a database of 15 authentic solo jazz template moves using the performances of a professional dancer dancing at 120 bpm. We analysed 36 new dance sequences, performed by the professional and five recreational dancers, following six dance tempos, ranging from 120 bpm to 220 bpm with 20 bpm increment steps. The recognition F1 scores, obtained cumulatively for all moves for different tempos, ranged from 0.87 to 0.98. The results indicate that the presented method can be used to recognise repeated dance moves and to assess the dancer’s consistency in performance. In addition, the results confirm the potential of using the presented method to recognise imitated dance moves, supporting the learning process.

• Language: English
• Keywords: motion recognition, motion analysis, inertial sensors, 3D accelerometer, 3D gyroscope, solo jazz, dancing
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FE - Faculty of Electrical Engineering
• Publication status: Published
• Publication version: Version of Record
• Year: 2022
• Number of pages: 21 str.
• Numbering: Vol. 22, iss. 7, art. 2446
• PID: 20.500.12556/RUL-136720
• UDC: 681.586:793.3
• ISSN on article: 1424-8220
• DOI: 10.3390/s22072446
• COBISS.SI-ID: 104154883
• Publication date in RUL: 18.05.2022

Record is a part of a journal

• Title: Sensors
• Shortened title: Sensors
• Publisher: MDPI
• ISSN: 1424-8220
• COBISS.SI-ID: 10176278

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
• Licensing start date: 01.04.2022

Secondary language

• Language: Slovenian
• Keywords: prepoznava gibanja, analiza gibanja, inercijski senzorji, 3D pospeškometer, 3D žiroskop, solo jazz, ples

Projects

• Funder: ARRS - Slovenian Research Agency
• Project number: P2-0246
• Name: ICT4QoL - Informacijsko komunikacijske tehnologije za kakovostno življenje