2017Assessment in Education Principles Policy and PracticeOpen access

Improving international assessment through evaluation

David Rutkowski

Open full text 5 citations

Abstract

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by authors in this special issue. The first limitation has to do with the quality of background questionnaires; the second, has to do with measuring trend over time; and the third emphasizes the thorny issue of making causal claims with cross-sectional ILSA data. Following this discussion, and drawing on Scriven’s higher level Meta-evaluation Checklist, I outline how national participation in a meta-evaluation of ILSAs may assist study administrators and ILSA users in creating data that better fits the needs of a complex and diverse set of participants.

Open-access reader

About this research paper

What this paper is about

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by authors in this special issue. The first limitation has to do with the quality of background questionnaires; the second, has to do with measuring trend over time; and the third emphasizes the thorny issue of making causal claims with cross-sectional ILSA data. Following this discussion, and drawing on Scriven’s higher level Meta-evaluation Checklist, I outline how national participation in a meta-evaluation of ILSAs may assist study administrators and ILSA users in creating data that better fits the needs of a complex and diverse set of participants.

Why it matters

OpenAlex reports 5 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by authors in this special issue. The first limitation has to do with the quality of background questionnaires; the second, has to do with measuring trend over time; and the third emphasizes the thorny issue of making causal claims with cross-sectional ILSA data. Following this discussion, and drawing on Scriven’s higher level Meta-evaluation Checklist, I outline how national participation in a meta-evaluation of ILSAs may assist study administrators and ILSA users in creating data that better fits the needs of a complex and diverse set of participants.

Key concepts: Checklist, Scale (ratio), Set (abstract data type), Quality (philosophy), Work (physics), Psychology, Field (mathematics), Applied psychology

Related papers

Back to paper searchBrowse research topicsOriginal source
Improving international assessment through evaluation — Research Paper | ScholarLens