Variable Selection in Latent Regression IRT Models via Knockoffs: An Application to International Large-scale Assessment in Education
share
International large-scale assessments (ILSAs) play an important role in educational research and policy making. They collect valuable data on education quality and performance development across many education systems, giving countries the opportunity to share techniques, organisational structures and policies that have proven efficient and successful. To gain insights from ILSA data, we identify non-cognitive variables associated with students' academic performance. This problem has three analytical challenges: 1) students' academic performance is measured by cognitive items under a matrix sampling design; 2) there are often many missing values in the non-cognitive variables; and 3) multiple comparisons due to a large number of non-cognitive variables. We consider an application to data from the Programme for International Student Assessment (PISA), aiming to identify non-cognitive variables associated with students' performance in science. We formulate it as a variable selection problem under a latent variable model and further propose a knockoff method that conducts variable selection with a controlled error rate for false selections. Keywords: Model-X knockoffs, item response theory, missing data, variable selection, international large-scale assessment
READ FULL TEXT