1985•Journal of International Crisis and Risk Communication ResearchOpen access

Analysis of Teaching Evaluation Instruments Collected by ACA.

Betty Jo Welch

Open full text 0 citations

Abstract

This article analyzes twenty nine student evaluation instruments collected from seventy five higher education institutions in the United States and Canada in order to determine how teaching effectiveness is conceptualized and measured. The study identifies substantial variation in instrument design yet finds seven recurring dimensions: organization, student teacher interaction and rapport, classroom skill and lecturing ability, workload and course difficulty, grading and evaluation, personal satisfaction, and course content. Representative literature is reviewed to assess the strengths and limitations of evaluation approaches such as alumni surveys, self evaluation, student achievement measures, classroom visitation, and peer review. Research evidence indicates that well constructed student rating instruments exhibit strong reliability and multiple forms of validity, although scores can be influenced by extraneous factors including class size, course requirement status, subject matter, and expected grades. Peer review and classroom visitation are found to be particularly vulnerable to bias and methodological limitations. The analysis concludes that student ratings, supplemented by systematic peer review of documentary evidence, provide the most defensible basis for personnel decisions. The article recommends periodic reassessment of evaluation instruments and clearer articulation of the institutional criteria underlying effective teaching.

About this research paper

What this paper is about

This article analyzes twenty nine student evaluation instruments collected from seventy five higher education institutions in the United States and Canada in order to determine how teaching effectiveness is conceptualized and measured. The study identifies substantial variation in instrument design yet finds seven recurring dimensions: organization, student teacher interaction and rapport, classroom skill and lecturing ability, workload and course difficulty, grading and evaluation, personal satisfaction, and course content. Representative literature is reviewed to assess the strengths and limitations of evaluation approaches such as alumni surveys, self evaluation, student achievement measures, classroom visitation, and peer review. Research evidence indicates that well constructed student rating instruments exhibit strong reliability and multiple forms of validity, although scores can be influenced by extraneous factors including class size, course requirement status, subject matter, and expected grades. Peer review and classroom visitation are found to be particularly vulnerable to bias and methodological limitations. The analysis concludes that student ratings, supplemented by systematic peer review of documentary evidence, provide the most defensible basis for personnel decisions. The article recommends periodic reassessment of evaluation instruments and clearer articulation of the institutional criteria underlying effective teaching.

Why it matters

A significance statement is not available in the OpenAlex record.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

This article analyzes twenty nine student evaluation instruments collected from seventy five higher education institutions in the United States and Canada in order to determine how teaching effectiveness is conceptualized and measured. The study identifies substantial variation in instrument design yet finds seven recurring dimensions: organization, student teacher interaction and rapport, classroom skill and lecturing ability, workload and course difficulty, grading and evaluation, personal satisfaction, and course content. Representative literature is reviewed to assess the strengths and limitations of evaluation approaches such as alumni surveys, self evaluation, student achievement measures, classroom visitation, and peer review. Research evidence indicates that well constructed student rating instruments exhibit strong reliability and multiple forms of validity, although scores can be influenced by extraneous factors including class size, course requirement status, subject matter, and expected grades. Peer review and classroom visitation are found to be particularly vulnerable to bias and methodological limitations. The analysis concludes that student ratings, supplemented by systematic peer review of documentary evidence, provide the most defensible basis for personnel decisions. The article recommends periodic reassessment of evaluation instruments and clearer articulation of the institutional criteria underlying effective teaching.

Key concepts: Higher education, Pedagogy, Psychology, Sociology, Mathematics education, Political science, Law

Related papers

Back to paper searchBrowse research topicsOriginal source
Analysis of Teaching Evaluation Instruments Collected by ACA. — Research Paper | ScholarLens