Item position effects in a reading comprehension test: An IRT study of individual differences and individual correlates

Journal articleResearchPeer reviewed

Publication data


ByGabriel Nagy, Benjamin Nagengast, Michael Becker, Norman Rose, Andreas Frey
Original languageEnglish
Published inPsychological Test and Assessment Modeling, 60(2)
Pages165-187
Editor (Publisher)Pabst Science Publ.
ISSN1614-9947, 2190-0493, 2190-0507
DOI/LinkNagy_Nagengast_Becker_Rose_Frey_2018_Item_position_effects_in_a_reading_comprehension_test.pdf (Open Access)
Publication statusPublished – 2018

Item position (IP) effects typically indicate that items become more difficult towards the end of a test. Such effects are thought to reflect the persistence with which test takers invest effort and work precisely on the test. As such, IP effects may be related to cognitive and motivational variables that are relevant for maintaining a high level of effort and precision. In this article, we analyzed IP effects in a reading comprehension test. We propose an IRT model that includes random IP effects affecting item difficulties and fixed IP effects affecting item discriminations. We found evidence for gradually increasing item difficulties and decreasing discriminations. Variation in IP effects on the item difficulties was systematically related to students’ decoding speed and reading enjoyment. The results demonstrate that the relationship between the overall scores and other variables is affected by respondents’ test-

taking behavior, which is reflected in the random IP effect.