ASSESSING THE TEST INFORMATION FUNCTION AND DIFFERENTIAL ITEM FUNCTIONING FOR THE TOEFL JUNIOR® STANDARD TEST
John W. Young, Rick L. Morgan, Paul Rybinski, Jonathan Steinberg, Yuan Wang
Abstract
Open-access reader
John W. Young, Rick L. Morgan, Paul Rybinski, Jonathan Steinberg, Yuan Wang
Abstract
Open-access reader
ABSTRACT The TOEFL Junior® Standard Test is an assessment that measures the degree to which middle school‐aged students learning English as a second language have attained proficiency in the academic and social English skills representative of English‐medium instructional environments. The assessment measures skills in three areas: listening comprehension, language form and meaning, and reading comprehension. This study focused on two specific psychometric characteristics of the assessment: (a) For which segments of its score scales does the assessment provide sufficient information to support the use of the scores in placement decisions? (b) Do items exhibit significant (or C‐level) differential item functioning (DIF) when comparisons are made between test‐takers from different countries? For the first question, both of the forms we analyzed appear to provide sufficient information to support placement decisions across the majority of the score scale for all 3 sections of the assessment. For the second question, we found that a moderate number of items exhibited significant DIF, while the linguistic analyses conducted on the DIF results showed plausible construct‐relevant explanations for most of the findings.
OpenAlex reports 11 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
ABSTRACT The TOEFL Junior® Standard Test is an assessment that measures the degree to which middle school‐aged students learning English as a second language have attained proficiency in the academic and social English skills representative of English‐medium instructional environments. The assessment measures skills in three areas: listening comprehension, language form and meaning, and reading comprehension. This study focused on two specific psychometric characteristics of the assessment: (a) For which segments of its score scales does the assessment provide sufficient information to support the use of the scores in placement decisions? (b) Do items exhibit significant (or C‐level) differential item functioning (DIF) when comparisons are made between test‐takers from different countries? For the first question, both of the forms we analyzed appear to provide sufficient information to support placement decisions across the majority of the score scale for all 3 sections of the assessment. For the second question, we found that a moderate number of items exhibited significant DIF, while the linguistic analyses conducted on the DIF results showed plausible construct‐relevant explanations for most of the findings.
Key concepts: Test of English as a Foreign Language, Psychology, Test (biology), Reading comprehension, Differential item functioning, Meaning (existential), Mathematics education, Comprehension