Wie valide sind Papier-und-Bleistift-Tests zur Erfassung computerbezogener Kompetenzen?

The aim of this study was to evaluate a paper-pencil test measuring computer-related competencies compared to a computer-based performance test. The paper-pencil test consisted of 36 items and was developed in the context of the German National Educational Panel Study (NEPS). Its psychometric quality was reviewed using a sample of 396 students from secondary school. In a within-persons design one half of the items were presented in a computer-based performance test to a subsample of 133; students the other half of the items were presented in a paper-pencil test to the same subsample. The convergent and discriminant validity of both test forms was reviewed by comparing the correlations with theoretically appropriate reference constructs (basic cognitive skills, computer-related student characteristics). Although the results indicate an adequate validity for both test forms, the computer-based performance test showed significantly better parameters regarding all criterion variables.