Item position effects in a reading comprehension test: An IRT study of individual differences and individual correlates
Journal article › Research › Peer reviewed
Publication data
| By | Gabriel Nagy, Benjamin Nagengast, Michael Becker, Norman Rose, Andreas Frey |
| Original language | English |
| Published in | Psychological Test and Assessment Modeling, 60(2) |
| Pages | 165-187 |
| Editor (Publisher) | Pabst Science Publ. |
| ISSN | 1614-9947, 2190-0493, 2190-0507 |
| DOI/Link | Nagy_Nagengast_Becker_Rose_Frey_2018_Item_position_effects_in_a_reading_comprehension_test.pdf |
| Publication status | Published – 2018 |
Item position (IP) effects typically indicate that items become more difficult towards the end of a test. Such effects are thought to reflect the persistence with which test takers invest effort and work precisely on the test. As such, IP effects may be related to cognitive and motivational variables that are relevant for maintaining a high level of effort and precision. In this article, we analyzed IP effects in a reading comprehension test. We propose an IRT model that includes random IP effects affecting item difficulties and fixed IP effects affecting item discriminations. We found evidence for gradually increasing item difficulties and decreasing discriminations. Variation in IP effects on the item difficulties was systematically related to students’ decoding speed and reading enjoyment. The results demonstrate that the relationship between the overall scores and other variables is affected by respondents’ test-
taking behavior, which is reflected in the random IP effect.