20.500.12556/RUL-137294 Lexical diversity in statistical and neural machine translation Neural machine translation systems have revolutionized translation processes in terms of quantity and speed in recent years, and they have even been claimed to achieve human parity. However, the quality of their output has also raised serious doubts and concerns, such as loss in lexical variation, evidence of “machine translationese”, and its effect on post-editing, which results in “post-editese”. In this study, we analyze the outputs of three English to Slovenian machine translation systems in terms of lexical diversity in three different genres. Using both quantitative and qualitative methods, we analyze one statistical and two neural systems, and we compare them to a human reference translation. Our quantitative analyses based on lexical diversity metrics show diverging results; however, translation systems, particularly neural ones, mostly exhibit larger lexical diversity than their human counterparts. Nevertheless, a qualitative method shows that these quantitative results are not always a reliable tool to assess true lexical diversity and that a lot of lexical “creativity”, especially by neural translation systems, is often unreliable, inconsistent, and misguided. machine translation neural translation systems lexical diversity type-token ratio measure of textual lexical diversity strojno prevajanje nevronski prevajalniki leksikalna diverziteta razmerje različnic in pojavnic merjenje besedilne leksikalne diverzitete true false true Angleški jezik Slovenski jezik Članek v reviji 2022-06-09 14:23:29 2022-06-09 14:23:29 2022-09-15 04:14:54 0000-00-00 00:00:00 2022 0 0 14 str. iss. 2, art. 93 Vol. 13 2022 0000-00-00 Zaloznikova Objavljeno NiDoloceno 0000-00-00 0000-00-00 0000-00-00 81\'25\'322.4 2078-2489 10.3390/info13020093 100548099 information-13-00093.pdf information-13-00093.pdf 1 F4D87D51688865324A5170F8B8C3EFF9 5f43a356a80cff9169d7b229d4545f44f975a6ccbd6467aec9c9561dd4c03d57 038f89bb-e7ef-11ec-8aca-00155dcfd717 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=157213 https://www.mdpi.com/2078-2489/13/2/93 0 cedf76f4-e7ee-11ec-8aca-00155dcfd717 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=157212 Filozofska fakulteta 0 0 0