Analysis of Teaching Evaluation Instruments Collected by ACA.
Betty Jo Welch
Abstract
Betty Jo Welch
Abstract
This article analyzes twenty nine student evaluation instruments collected from seventy five higher education institutions in the United States and Canada in order to determine how teaching effectiveness is conceptualized and measured. The study identifies substantial variation in instrument design yet finds seven recurring dimensions: organization, student teacher interaction and rapport, classroom skill and lecturing ability, workload and course difficulty, grading and evaluation, personal satisfaction, and course content. Representative literature is reviewed to assess the strengths and limitations of evaluation approaches such as alumni surveys, self evaluation, student achievement measures, classroom visitation, and peer review. Research evidence indicates that well constructed student rating instruments exhibit strong reliability and multiple forms of validity, although scores can be influenced by extraneous factors including class size, course requirement status, subject matter, and expected grades. Peer review and classroom visitation are found to be particularly vulnerable to bias and methodological limitations. The analysis concludes that student ratings, supplemented by systematic peer review of documentary evidence, provide the most defensible basis for personnel decisions. The article recommends periodic reassessment of evaluation instruments and clearer articulation of the institutional criteria underlying effective teaching.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
This article analyzes twenty nine student evaluation instruments collected from seventy five higher education institutions in the United States and Canada in order to determine how teaching effectiveness is conceptualized and measured. The study identifies substantial variation in instrument design yet finds seven recurring dimensions: organization, student teacher interaction and rapport, classroom skill and lecturing ability, workload and course difficulty, grading and evaluation, personal satisfaction, and course content. Representative literature is reviewed to assess the strengths and limitations of evaluation approaches such as alumni surveys, self evaluation, student achievement measures, classroom visitation, and peer review. Research evidence indicates that well constructed student rating instruments exhibit strong reliability and multiple forms of validity, although scores can be influenced by extraneous factors including class size, course requirement status, subject matter, and expected grades. Peer review and classroom visitation are found to be particularly vulnerable to bias and methodological limitations. The analysis concludes that student ratings, supplemented by systematic peer review of documentary evidence, provide the most defensible basis for personnel decisions. The article recommends periodic reassessment of evaluation instruments and clearer articulation of the institutional criteria underlying effective teaching.
Key concepts: Higher education, Pedagogy, Psychology, Sociology, Mathematics education, Political science, Law