Details

Analiza uporabe pozivov pri delu z generativno umetno inteligenco
ID Pahor, Erik (Author), ID Fujs, Damjan (Mentor) More about this mentor... This link opens in a new window

.pdfPDF - Presentation file, Download (1,16 MB)
MD5: 8AB324B0C61A0D8BB4F24F7EE23652AA

Abstract
Generativna umetna inteligenca je postala vsakdanje orodje pri razvoju programske opreme, osrednji način dela z njo pa je pozivanje. Klasične mere produktivnosti zajamejo izid, ne pa bremena poti do njega. V tem delu to breme poimenujemo breme pozivanja (angl. prompting tax), tj. čas, trud in delo pregledovanja pri pridobivanju delujoče kode iz pomočnika z umetno inteligenco. Razvili smo eksperimentalno platformo z urejevalnikom kode, klepetalnim pomočnikom in samodejnim preverjanjem ter izvedli študijo uporabnikov na treh programerskih nalogah. Analiza 56 nalog, ki jih je rešilo 27 udeležencev, kaže, da ima breme merljiv vedenjski podpis, ki tesno sledi zaznanemu trudu, da ne prinaša večje pravilnosti rešitve, da se zgosti pri najtežji nalogi ter da se z vajo ne zmanjša. Samozavest in izkušnje pa ne napovedujejo, kdo mu je bolj izpostavljen. Odkrivamo tudi skrito breme pregledovanja v obliki zamaknjenega preverjanja predlaganih sprememb in analiziramo strategije pozivanja udeležencev.

Language:Slovenian
Keywords:Interakcija človek-računalnik, generativna umetna inteligenca, oblikovanje pozivov, študija uporabnikov, produktivnost uporabnikov, veliki jezikovni modeli
Work type:Master's thesis/paper
Typology:2.09 - Master's Thesis
Organization:FRI - Faculty of Computer and Information Science
Year:2026
PID:20.500.12556/RUL-186501 This link opens in a new window
COBISS.SI-ID:290045443 This link opens in a new window
Publication date in RUL:02.09.2026
Views:166
Downloads:47
Metadata:XML DC-XML DC-RDF
:
Copy citation
Share:Bookmark and Share

Secondary language

Language:English
Title:Analysis of prompting practices when working with generative artificial intelligence
Abstract:
Generative artificial intelligence has become an everyday tool in software development, with prompting as the primary mode of interaction. Conventional productivity measures capture the outcome but not the cost of reaching it. We call this cost the prompting tax, i.e. the time, effort, and review cost of obtaining working code from an AI assistant. We built an experimental platform combining a code editor, a chat assistant, and automated testing, and ran a user study on three programming tasks. An analysis of 56 tasks solved by 27 participants shows that the tax has a measurable behavioural signature closely tracking perceived effort, that it does not buy higher correctness, that it concentrates on the hardest task, and that it does not ease with practice, while neither confidence nor experience predicts who pays it. We also identify a hidden review tax in the form of deferred verification of proposed code edits, and analyse participants' prompting strategies.

Keywords:human-computer interaction, generative artificial intelligence, prompting, user study, user productivity, large language models

Similar documents

Similar works from RUL:
Similar works from other Slovenian collections:

Back