Exploring the effects of multimodal user interfaces in autonomous vehicles

Stojmenova Pečečnik, Kristina (avtor), Gruden, Timotej (avtor), Jakus, Grega (avtor), Tomažič, Sašo (avtor), Sodnik, Jaka (avtor)

This short paper presents a study design created to explore how multimodal user interfaces (UIs) influence comfort, user experience, and overall well-being in fully autonomous vehicles. The study uses a motion-based driving simulator equipped with real vehicle components to provide realistic driving conditions. Participants are asked to complete two trials: a baseline trial and one with either a simple or extended multimodal UI combining auditory, tactile, and speech-based feedback. Driving scenarios include lane changes, emergency braking, V2X and V2V communication, and road surface variations. Data collection integrates physiological measures (EGG, EDA, PPG), self-assessment questionnaires on motion sickness (MSAQ) and user experience (UEQ), and performance on a reading comprehension task simulating non-driving activities. The paper provides some initial data about the participants’ demographics and their user experience with the UI, and gives an insight into the planned nest steps in terms of analysis and results application. The findings from this study will provide an insight into the potential of multimodal HMI design to enhance safety, comfort, and user acceptance in autonomous vehicles.

• Jezik: Angleški jezik
• Ključne besede: user interface, autonomous vehicle, multimodal interaction, non-driving related task
• Tipologija: 1.08 - Objavljeni znanstveni prispevek na konferenci
• Organizacija: FE - Fakulteta za elektrotehniko
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2025
• Št. strani: Str. 181-186
• PID: 20.500.12556/RUL-179025
• UDK: 004.5:629.33.052
• DOI: 10.26493/978-961-293-559-7.17
• COBISS.SI-ID: 267101187
• Datum objave v RUL: 03.02.2026

Gradivo je del monografije

• Naslov: HCI SI Koper 2025 : proceedings of the 10th Human-Computer Interaction Slovenia Conference
• Kraj izida: Koper
• Založnik: University of Primorska Press
• Leto izida: 2025
• ISBN: 978-961-293-559-7
• COBISS.SI-ID: 266380291
• Prireditelj konference: University of Primorska, Faculty of Mathematics, Natural Sciences and Information Technologies, Koper, Slovenia

Licence

• Licenca: CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by/4.0/deed.sl
• Opis: To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.

Sekundarni jezik

• Jezik: Slovenski jezik
• Ključne besede: uporabniški vmesnik, avtonomno vozilo, multimodalna interakcija, naloge, ki niso povezane z vožnjo

Projekti

• Financer: ARIS - Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije
• Številka projekta: P2-0246
• Naslov: ICT4QoL - Informacijsko komunikacijske tehnologije za kakovostno življenje

• Financer: EC - European Commission
• Številka projekta: 101147819
• Naslov: Federated cybeR-physical infrastructure for ODD cOntinuity
• Akronim: FRODDO