Exploring Differential Item Functioning in PISA 2015 Science Test with the Rasch-tree
Korean Society for Educational Evaluation, Yoonsun Jang, Juyeon Lee
Abstract
Korean Society for Educational Evaluation, Yoonsun Jang, Juyeon Lee
Abstract
The purpose of this study is to introduce the Rasch-tree, which is Rasch model-based recursive partitioning, as a new method for differential item functioning(DIF) detection and to examine its usefulness by exploring DIF in PISA 2015 Science test data with the Rasch-tree. This study used 16 items binary response of PISA 2015 Science test and 41 variables related to the student, parent, family, teacher, science, and ICT. The results of this study showed that there are four subgroups splitted by the three variables, ‘Enjoyment of Science(JOYSCICE)’, ‘gender’, and ‘Child’s past science activities(PRESUPP)’, and the two DIF items were detected. These items had large differences in the estimate item difficulty parameters between these four subgroups, especially the group of students with high level of JOYSCIE and the group of female students with relatively low level of JOYSCIE. For these results, it was confirmed that the Rasch-tree could be effective for exploring DIF between latent classes by considering simultaneously multiple trait variables.
OpenAlex reports 3 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
The purpose of this study is to introduce the Rasch-tree, which is Rasch model-based recursive partitioning, as a new method for differential item functioning(DIF) detection and to examine its usefulness by exploring DIF in PISA 2015 Science test data with the Rasch-tree. This study used 16 items binary response of PISA 2015 Science test and 41 variables related to the student, parent, family, teacher, science, and ICT. The results of this study showed that there are four subgroups splitted by the three variables, ‘Enjoyment of Science(JOYSCICE)’, ‘gender’, and ‘Child’s past science activities(PRESUPP)’, and the two DIF items were detected. These items had large differences in the estimate item difficulty parameters between these four subgroups, especially the group of students with high level of JOYSCIE and the group of female students with relatively low level of JOYSCIE. For these results, it was confirmed that the Rasch-tree could be effective for exploring DIF between latent classes by considering simultaneously multiple trait variables.
Key concepts: Rasch model, Differential item functioning, Polytomous Rasch model, Psychology, Test (biology), Item response theory, Trait, Tree (set theory)