Judgment accuracy in experienced versus student teachers: Assessing essays in English as a foreign language

Journal articleResearchPeer reviewed

Publication data


ByThorben Jansen, Cristina Vögelin, Nils Machts, Stefan Keller, Olaf Köller, Jens Möller
Original languageEnglish
Published inTeaching and Teacher Education, 97, Article 103216
Pages1-11
Editor (Publisher)Elsevier
ISSN0742-051X, 1879-2480
DOI/Linkhttps://doi.org/10.1016/j.tate.2020.103216
Publication statusPublished – 01.2021

Teacher judgment accuracy (TJA) is a central part of diagnostic competence. Research has revealed heterogeneous results regarding teacher characteristics as determinants of TJA. In the present experimental study N = 36 experienced and N = 47 student teachers holistically and analytically assessed four student essays. We compared the judgments of teachers and student teachers to machine scores and expert ratings. Experienced teachers’ judgments were more negative than student teachers’, and both judgments were more negative than those made by experts, and the machine. The results remained stable, even after controlling for content knowledge. They are discussed in relation to the assumption of an expert-blind-spot.