Automated analysis of postings in fourth grade online discussions to help teachers keep students on-track

Žitnik, Slavko (author), Smith, Glenn Gordon (author)

In the recent, and ongoing, Covid-19 pandemic, remote or online K-12 schooling became the norm. Even if the pandemic tails off somewhat, remote K-12 schooling will likely remain more frequent than it was before the pandemic. A mainstay technique of online learning, at least at the college and graduate level, has been the online discussion. Since it does afford the potential for meaningful learner-learner and instructor-learner interaction, which are vital for distance learning, it is worth considering online discussions for K-12 remote schooling. One challenge with online learning in general, and online discussion in particular, is that it is labor intensive for teachers to moderate. Effective moderating of online discussions is vital for discussions to be nurturing, effective learning situations. Yet, moderating of online discussions is notoriously labor-intensive for teachers/instructors. Further, since younger learners are more likely to drift off topic, in general, but particularly in small group online discussions, automated early warning systems are helpful. The current study collected small group, “book club”, discussion data from fourth graders reading web-based eBooks in Slovenian primary schools, qualitatively coded the data and analyzed postings using computer-based natural language processing to predict when students went off-topic. One indicator that postings are on-topic is book relevance, i.e. that the posting is relevant to eBook content. The computer algorithm correctly predicted book relevance of postings 90 percent of the time, suggesting that automated computer algorithms could assist teachers with moderating online discussions, providing real-time notifications of problems in online discussions. Further, this study provided a proof-of-concept that small group online discussions, in web-based eBooks can be practical and educationally meaningful in fourth grade classes.

• Language: English
• Keywords: online discussion analysis, education, short text classification, natural language processing, reading comprehension, focused discussions
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FRI - Faculty of Computer and Information Science
• Publication status: Published
• Publication version: Version of Record
• Year: 2024
• Number of pages: Str. 4587–4612
• Numbering: Vol. 32, no. 8
• PID: 20.500.12556/RUL-163818
• UDC: 004:81'322
• ISSN on article: 1049-4820
• DOI: 10.1080/10494820.2023.2204327
• COBISS.SI-ID: 171087363
• Publication date in RUL: 11.10.2024

Record is a part of a journal

• Title: Interactive learning environments
• Shortened title: Interact. learn. environ.
• Publisher: Taylor & Francis
• ISSN: 1049-4820
• COBISS.SI-ID: 676373

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

• Language: Slovenian
• Keywords: avtomatizirana analiza spletnih dialogov, izobraževanje, uvrščanje kratkih besedil, obdelava naravnega jezika, bralno razumevanje, fokusirane diskusije