2013•ETS Research Report SeriesOpen access

ASSESSING THE TEST INFORMATION FUNCTION AND DIFFERENTIAL ITEM FUNCTIONING FOR THE TOEFL JUNIOR® STANDARD TEST

John W. Young, Rick L. Morgan, Paul Rybinski, Jonathan Steinberg, Yuan Wang

Open full text 11 citations

Abstract

ABSTRACT The TOEFL Junior® Standard Test is an assessment that measures the degree to which middle school‐aged students learning English as a second language have attained proficiency in the academic and social English skills representative of English‐medium instructional environments. The assessment measures skills in three areas: listening comprehension, language form and meaning, and reading comprehension. This study focused on two specific psychometric characteristics of the assessment: (a) For which segments of its score scales does the assessment provide sufficient information to support the use of the scores in placement decisions? (b) Do items exhibit significant (or C‐level) differential item functioning (DIF) when comparisons are made between test‐takers from different countries? For the first question, both of the forms we analyzed appear to provide sufficient information to support placement decisions across the majority of the score scale for all 3 sections of the assessment. For the second question, we found that a moderate number of items exhibited significant DIF, while the linguistic analyses conducted on the DIF results showed plausible construct‐relevant explanations for most of the findings.

Open-access reader

About this research paper

What this paper is about

ABSTRACT The TOEFL Junior® Standard Test is an assessment that measures the degree to which middle school‐aged students learning English as a second language have attained proficiency in the academic and social English skills representative of English‐medium instructional environments. The assessment measures skills in three areas: listening comprehension, language form and meaning, and reading comprehension. This study focused on two specific psychometric characteristics of the assessment: (a) For which segments of its score scales does the assessment provide sufficient information to support the use of the scores in placement decisions? (b) Do items exhibit significant (or C‐level) differential item functioning (DIF) when comparisons are made between test‐takers from different countries? For the first question, both of the forms we analyzed appear to provide sufficient information to support placement decisions across the majority of the score scale for all 3 sections of the assessment. For the second question, we found that a moderate number of items exhibited significant DIF, while the linguistic analyses conducted on the DIF results showed plausible construct‐relevant explanations for most of the findings.

Why it matters

OpenAlex reports 11 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

ABSTRACT The TOEFL Junior® Standard Test is an assessment that measures the degree to which middle school‐aged students learning English as a second language have attained proficiency in the academic and social English skills representative of English‐medium instructional environments. The assessment measures skills in three areas: listening comprehension, language form and meaning, and reading comprehension. This study focused on two specific psychometric characteristics of the assessment: (a) For which segments of its score scales does the assessment provide sufficient information to support the use of the scores in placement decisions? (b) Do items exhibit significant (or C‐level) differential item functioning (DIF) when comparisons are made between test‐takers from different countries? For the first question, both of the forms we analyzed appear to provide sufficient information to support placement decisions across the majority of the score scale for all 3 sections of the assessment. For the second question, we found that a moderate number of items exhibited significant DIF, while the linguistic analyses conducted on the DIF results showed plausible construct‐relevant explanations for most of the findings.

Key concepts: Test of English as a Foreign Language, Psychology, Test (biology), Reading comprehension, Differential item functioning, Meaning (existential), Mathematics education, Comprehension

Related papers

Back to paper searchBrowse research topicsOriginal source
ASSESSING THE TEST INFORMATION FUNCTION AND DIFFERENTIAL ITEM FUNCTIONING FOR THE TOEFL JUNIOR® STANDARD TEST — Research Paper | ScholarLens