The reliability and medical students’ appreciation of certainty-based marking

Smrkolj, Špela (author), Bančov, Enja (author), Smrkolj, Vladimir (author)

Certainty-Based Marking (CBM) involves asking students not only the answer to an objective question, but also how certain they are that their answer is correct. In a mixed method design employing an embedded approach with a quasi-experimental design, we have examined the use of CBM during a 5-week Gynaecology and Obstetrics course. The study was conducted as a non-mandatory revision exam with two additional questionnaires on Moodle. Majority of students perceive CBM as fair (78%) and useful (94%). Most students would immediately want CBM to be used for revision exams, but more practice would be needed for CBM to be used in graded exams. The lowest self-evaluation of knowledge was mostly seen by worst (less than 70% Accuracy) and best achievers (more than 90% Accuracy); the worst achievers probably have knowledge gaps, and the best achievers probably correctly guessed at least one question. Our findings conclude that CBM does not discriminate any learner type (p = 0.932) and does not change the general distribution of the exam scores, since there is no significant differences between Certainty-Based Score (M = 80.4%, SD = 10.4%) and Accuracy (M = 79.8%, SD = 11.1%); t(176) = 0.8327, p = 0.4061. These findings are widely applicable, as learner type study models are used extensively in education. In the future, larger samples should be studied and the implementation of CBM on question types other than MCQ should be investigated.

• Language: English
• Keywords: certainty-based marking, confidence-based learning, undergraduate medical education, online exam, self-evaluation
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: MF - Faculty of Medicine
• Publication status: Published
• Publication version: Version of Record
• Year: 2022
• Number of pages: 11 str.
• Numbering: Vol. 19, iss. 3, art. 1706
• PID: 20.500.12556/RUL-137356
• UDC: 61
• ISSN on article: 1660-4601
• DOI: 10.3390/ijerph19031706
• COBISS.SI-ID: 97876483
• Publication date in RUL: 14.06.2022

Record is a part of a journal

• Title: International journal of environmental research and public health
• Shortened title: Int. j. environ. res. public health
• Publisher: MDPI
• ISSN: 1660-4601
• COBISS.SI-ID: 1818965

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.
• Licensing start date: 02.02.2022

Secondary language

• Language: Slovenian
• Keywords: študij medicine, medicinsko izobraževanje, spletni izpiti, samoocenjevanje