20.500.12556/RUL-181096 Evaluating robustness of LLMs in question answering on multilingual noisy OCR data Optical Character Recognition (OCR) plays a crucial role in digitizing historical and multilingual documents, yet OCR errors - imperfect extraction of text, including character insertion, deletion, and substitution can significantly impact downstream tasks like question-answering (QA). In this work, we conduct a comprehensive analysis of how OCR-induced noise affects the performance of Multilingual QA Systems. To support this analysis, we introduce a multilingual QA dataset MultiOCR-QA, comprising 50K question-answer pairs across three languages, English, French, and German. The dataset is curated from OCR-ed historical documents, which include different levels and types of OCR noise. We then evaluate how different state-of-the-art Large Language Models (LLMs) perform under different error conditions, focusing on three major OCR error types. Our findings show that QA systems are highly prone to OCR-induced errors and perform poorly on noisy OCR text. By comparing model performance on clean versus noisy texts, we provide insights into the limitations of current approaches and emphasize the need for more noise-resilient QA systems in historical digitization contexts. multilingual QA OCR text large language models večjezično zagotavljanje kakovosti optično prepoznavanje besedila veliki jezikovni modeli true false false Angleški jezik Slovenski jezik Drugo 2026-03-25 08:17:24 2026-03-25 08:17:26 2026-03-26 04:21:47 0000-00-00 00:00:00 2025 0 0 Str. 2366-2376 0000-00-00 Zaloznikova Objavljeno NiDoloceno 0000-00-00 0000-00-00 0000-00-00 004.85:004.352.242:81'322 10.1145/3746252.3761295 272786691 272764675 https://doi.org/10.1145/3746252.3761295 1 8df3cc6b-281a-11f1-b0ab-0050569b8976 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=231267 RAZ_Piryani_Bhawna_2025.pdf RAZ_Piryani_Bhawna_2025.pdf 1 A9B7F26E6F89C804437345EC8B7760D1 199f58468624bbd4f280857ac8205138e0a2b214cf0c494d87e6afe951bfadf6 5d01143b-281b-11f1-b0ab-0050569b8976 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=231270 Fakulteta za računalništvo in informatiko 0 0 0