Generative AI in pragmaticsTodorović, Tadej (Avtor) Flogie, Andrej (Avtor) Hari, Daniel (Avtor) pragmaticsspeech act analysesChatGPTDeepSeekGeminiThis study explores the feasibility of using generative AI (ChatGPT, Gemini, and DeepSeek) to automate speech act annotation in Harold Pinter's play The Birthday Party. Three chatbots - ChatGPT, Gemini, and DeepSeek - were tested under three scenarios varying in the amount of theoretical material provided. Each chatbot's output was compared to a manually annotated reference via a Python script measuring classification accuracy. Scenario 2 produced the highest accuracy overall (75-82%), while Scenario 1 underperformed, owing to incorrect reliance on external typologies, and Scenario 3 showed signs of overfitting. ChatGPT o1 emerged as the most accurate model, achieving 82% accuracy in Scenario 2. The findings suggest that GenAI chatbots can serve as valuable preliminary annotators when good prompt-engineering and well-curated theoretical material are provided. Future research could extend this methodology to more context-dependent texts, further refining prompt-engineering strategies and exploring larger linguistic corpora.20252026-03-02 12:38:45Članek v reviji180084sl