Details

ImproVisAR : designing augmented reality piano roll for teaching improvisation
ID Deja, Jordan Aiko (Author), ID Štor, Sandi (Author), ID Pucihar, Ilonka (Author), ID Weerasinghe Arachchillage, Anuradhi Maheshya W. (Author), ID Balbin, Rafael Marco (Author), ID Čopič Pucihar, Klen (Author), ID Kljun, Matjaž (Author)

.pdfPDF - Presentation file, Download (2,46 MB)
MD5: 4575BA78B2966EA25B31C633F9ED5B29
URLURL - Source URL, Visit https://link.springer.com/article/10.1007/s10055-025-01215-z This link opens in a new window

Abstract
Improvisation is an important skill in music instrument learning, but remains a less-taught topic in traditional piano education. To improvise effectively, learners must develop musical vocabulary, creative confidence, and comfort in performance. These demands make piano improvisation a complex teaching challenge where technology interventions may offer support. Prior short-term studies on augmented piano roll visualisations have shown promise for teaching sight-reading and motor coordination in novice students. However, how such approaches can support advanced learners in acquisition of improvisational skills remains under-explored. To address this gap, we present ImproVisAR, an interactive piano training system that teaches improvisation through augmented piano roll visualisations. Concepts and tools derived from a codesign process with improvisation experts are integrated as structured learning modes. We validated the system through a four-day controlled study (n = 6) comparing an AR-based condition with a traditional sheet music condition following a mixed-methods approach to data analysis. We collected and analysed subjective ratings of cognitive load, creativity support, user-experience, expert evaluation of performances, interaction logs, and qualitative insights collected from daily post-study interviews. Our findings show that participants experienced reduced cognitive load over time, sustained engagement across sessions, and AR participants showed higher expert-rated scores, particularly in rhythm, flow, musicality and overall musical impression. Participants also reported greater immersion, freedom to create musical content and motivation to continue playing. We discuss these findings in relation to user experience and creativity support, and offer design recommendations for AR systems that aim to teach complex, expressive skills such as musical improvisation.

Language:English
Keywords:augmented reality, projections, piano, jazz, improvisation, training system
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:AG - Academy of Music
Publication status:Published
Publication version:Version of Record
Year:2025
Number of pages:19 str.
Numbering:Vol. 29, iss. 3, art. 140
PID:20.500.12556/RUL-178850 This link opens in a new window
UDC:004.439:004.94VRML:780.616.433
ISSN on article:1359-4338
DOI:10.1007/s10055-025-01215-z This link opens in a new window
COBISS.SI-ID:248149251 This link opens in a new window
Publication date in RUL:30.01.2026
Views:527
Downloads:270
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Record is a part of a journal

Title:Virtual reality
Shortened title:Virtual real.
Publisher:Springer Nature
ISSN:1359-4338
COBISS.SI-ID:512039961 This link opens in a new window

Licences

License:CC BY 4.0, Creative Commons Attribution 4.0 International
Link:http://creativecommons.org/licenses/by/4.0/
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

Language:Slovenian
Keywords:dopolnjena resničnosti, projekcije, klavir, jazz, improvizacija, sistem usposabljanja

Projects

Funder:ARRS - Slovenian Research Agency
Project number:N2-0354
Name:Določanje uporabniške izkušnje z računalniškim psihološkim modeliranjem

Funder:ARRS - Slovenian Research Agency
Project number:BI-NO/25-27-007
Name:Uporabniški modeli za razložljive priporočilne sisteme

Funder:ARRS - Slovenian Research Agency
Project number:P5-0433
Name:Digitalno prestrukturiranje deficitarnih poklicev za družbo 5.0 (industrijo 4.0)

Funder:ARRS - Slovenian Research Agency
Project number:I0-0035
Name:Infrastrukturna skupina Univerze na Primorskem

Funder:ARRS - Slovenian Research Agency
Project number:J5-50155
Name:Dopolnjena resničnost za doseganje boljšega razumevanja trojne narave kemijskih pojmov

Funder:ARRS - Slovenian Research Agency
Project number:J7-50096
Name:Izboljšanje sistema B-WIM na osnovi masovnih podatkov in umetne inteligence

Funder:ARRS - Slovenian Research Agency
Project number:0013103
Name:CogniCom

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back