20.500.12556/RUL-183622 Position explainable AI cannot advance without better user studies In this position paper, we argue that user studies are key to understanding the value of explainable AI methods, because the end goal of explainable AI is to satisfy societal desiderata. We also argue that the current state of user studies is detrimental to the advancement of the field. We support this argument with a review of general and explainable AI-specific challenges, as well as an analysis of 607 explainable AI papers featuring user studies. We demonstrate how most user studies lack reproducibility, discussion of limitations, comparison with a baseline, or placebo explanations and are of low fidelity to real-world users and application context. This, combined with an overreliance on functional evaluation, results in a lack of understanding of the value explainable AI methods, which hinders the progress of the field. To address this issue, we call for higher methodological standards for user studies, greater appreciation of high-quality user studies in the AI community, and reduced reliance on functional evaluation. explainable artificial intelligence explanation of artificial intelligence evaluation of artificial intelligence users social aspects razlaga umetne inteligence razložljiva umetna inteligenca vrednotenje umetne inteligence uporabniki družbeni vidiki true false true Angleški jezik Slovenski jezik Informacija o licenci CC BY 4.0 je bila pridobljena s strani avtorjev članka. (Datum opombe: 22. 6. 2026) Neznano 2026-06-17 02:49:29 2026-06-22 13:37:50 2026-06-23 04:00:57 0000-00-00 00:00:00 2025 0 0 18 str. 0000-00-00 Zaloznikova Objavljeno NiDoloceno 0000-00-00 0000-00-00 0000-00-00 004.8 255898115 255897859 piculin25a-2.pdf piculin25a-2.pdf 1 863DF9903AFE3036DA639F1B23D86978 9273c75ccb2e42ae2961ef3e46a29a03d855099018f6e326986c791be3f7144e 637c8bd0-69e6-11f1-9b0d-0050569b8976 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=235745 https://proceedings.mlr.press/v267/piculin25a.html 0 7a862959-6b07-11f1-9b0d-0050569b8976 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=235951 Fakulteta za računalništvo in informatiko 0 0 0