SloBenchDRAGAR, FRENK (Avtor) Žitnik, Slavko (Mentor) natural language processingbenchmarkingleaderboardmachine learningweb platformEvaluation of natural language processing (NLP) tasks is an essential part of research and progress in the field. It provides an objective standard for comparison and performance on a specific task. We give an overview of recent public benchmarks and evaluation trends, with focus on the automatic evaluation of systems. We then propose, implement and document a general and extendable model-agnostic evaluation framework, along with the first online platform for the automatic evaluation of Slovene language NLP tasks with public leaderboards, showing the performance of submitted systems.20222022-04-21 09:10:04Diplomsko delo/naloga136261sl