Measuring digital literacy across three age cohorts: Exploring test dimensionality and performance differences

Abstract

Digital literacy (DL) is an important capacity for students’ learning in a rapidly changing world. However, tension exists between the theoretical conceptualizations of DL as a multidimensional construct and empirical studies reporting unidimensional DL scores. Also, little is known about how DL may vary among different age cohorts, and whether and at which age do performance gaps emerge with respect to gender. The focus of this research is to develop a test appropriate for measuring DL performance at different ages and a comprehensive DL assessment framework has been adopted for this purpose. Using data from three age cohorts of students (one from primary schools and two from secondary schools), the dimensionality of DL and performance differences are examined. Comparisons of unidimensional and multidimensional item response models suggest the measured DL to be a unidimensional construct. The results also show that secondary school students obtained higher levels of DL compared to primary school students. A gender gap in DL is found among secondary school students. There is also a need for further research to understand through longitudinal studies the emergence of the gender gap in DL performance.