A context-aware decision support framework for scientific experiment configuration

Miri, Pouriya (author), Stankovski, Vlado (author), Veljković, Kristina (author), Kochovski, Petar (author)

Introduction: Defining an experimental configuration is a complex decision problem for early-stage researchers, who must map goals, constraints, and requirements onto datasets, algorithms, and parameter settings that directly affect experimental outcomes. Existing scientific workflow engines improve execution and reproducibility; however, they rarely capture the decision rationale behind configuration choices, which is needed to inform future selections. Method: We propose a context-aware decision-support framework that formalises experiment configuration as a structured and sequential decision problem. The framework combines three components: a semantic Knowledge Graph (KG) storing historical configurations, contextual attributes, and decision rationale; an MDP-based Option Explorer that filters the KG under user-defined constraints and ranks feasible configurations by expected cumulative reward; and a Graphical User Interface for specifying constraints, inspecting ranked alternatives, and providing structured feedback. Unlike existing workflow systems, the framework explicitly separates user-defined context from automated reasoning, producing an interpretable ranked list rather than a single opaque recommendation. We evaluated the framework in a user study with 90 MSc- and PhD-level researchers performing a model-selection task, using a synthetic dataset of one million experimental configurations under three levels of contextual detail. Results: Compared with manual search, the framework reduced decision time (up to 68%), reduced perceived difficulty (up to 36%), and increased user satisfaction (up to 43%) under the constrained condition. Conclusion: By formalising the link between experimental context and probabilistic decision ranking, the framework improves reproducibility and scalability of decision support in scientific experimentation.

• Language: English
• Keywords: contextualisation, decision-making, human–AI interaction, Markov decision process, MDP, scientific experiment
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FRI - Faculty of Computer and Information Science
• Publication status: Published
• Publication version: Version of Record
• Year: 2026
• Number of pages: Str. 1-20
• Numbering: Vol. , no.
• PID: 20.500.12556/RUL-183995
• UDC: 004.8
• ISSN on article: 0038-0644
• DOI: 10.1002/spe.70085
• COBISS.SI-ID: 279799811
• Publication date in RUL: 23.06.2026

Record is a part of a journal

• Title: Software : practice & experience
• Shortened title: Softw. pract. exp.
• Publisher: Wiley
• ISSN: 0038-0644
• COBISS.SI-ID: 5222919

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

• Language: Slovenian
• Keywords: kontekstualizacija, odločanje, interakcija med človekom in umetno inteligenco, Markovski odločitveni proces, znanstveni eksperiment