2011Journal of Operations ManagementRequires access

Impact factor as a metric to assess journals where OM research is published

Jeffrey S. Stonebraker, Esther Gil, Craig W. Kirkwood, Robert Handfield

Open publisher page 27 citations

Abstract

Highlights ► We conducted an exhaustive comparison of OM journal rankings based on impact factors versus other ranking methods (113 characters) ► Impact factors are useful metrics to rank OM journals (53 characters) ► Impact factor rankings alone are not a replacement for survey‐based, citation‐based, or author‐based methods (108 characters) ► Impact factors evaluate OM journal quality from another perspective and can be used with other methods to rank OM journals (122 characters) ► Impact factors are likely to shape and influence future perception of OM journal quality (88 characters) This paper investigates impact factor as a metric for ranking the quality of journal outlets for operations management (OM) research. We review all prior studies that assessed journal outlets for OM research and compare all previous OM journal quality rankings to rankings based on impact factors. We find that rankings based on impact factors that use data from different time periods are highly correlated and provide similar rankings of journals using either two‐year or five‐year assessment periods, either with or without self‐citations. However, some individual journals have large rank changes using different impact factor specifications. We also find that OM journal rankings based on impact factors are only moderately correlated with journal quality rankings previously determined using other methods, and the agreement among these other methods in ranking the quality of OM journals is relatively modest. Thus, impact factor rankings alone are not a replacement for the assessment methods used in previous studies, but rather they evaluate OM journals from another perspective.

About this research paper

What this paper is about

Highlights ► We conducted an exhaustive comparison of OM journal rankings based on impact factors versus other ranking methods (113 characters) ► Impact factors are useful metrics to rank OM journals (53 characters) ► Impact factor rankings alone are not a replacement for survey‐based, citation‐based, or author‐based methods (108 characters) ► Impact factors evaluate OM journal quality from another perspective and can be used with other methods to rank OM journals (122 characters) ► Impact factors are likely to shape and influence future perception of OM journal quality (88 characters) This paper investigates impact factor as a metric for ranking the quality of journal outlets for operations management (OM) research. We review all prior studies that assessed journal outlets for OM research and compare all previous OM journal quality rankings to rankings based on impact factors. We find that rankings based on impact factors that use data from different time periods are highly correlated and provide similar rankings of journals using either two‐year or five‐year assessment periods, either with or without self‐citations. However, some individual journals have large rank changes using different impact factor specifications. We also find that OM journal rankings based on impact factors are only moderately correlated with journal quality rankings previously determined using other methods, and the agreement among these other methods in ranking the quality of OM journals is relatively modest. Thus, impact factor rankings alone are not a replacement for the assessment methods used in previous studies, but rather they evaluate OM journals from another perspective.

Why it matters

OpenAlex reports 27 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Highlights ► We conducted an exhaustive comparison of OM journal rankings based on impact factors versus other ranking methods (113 characters) ► Impact factors are useful metrics to rank OM journals (53 characters) ► Impact factor rankings alone are not a replacement for survey‐based, citation‐based, or author‐based methods (108 characters) ► Impact factors evaluate OM journal quality from another perspective and can be used with other methods to rank OM journals (122 characters) ► Impact factors are likely to shape and influence future perception of OM journal quality (88 characters) This paper investigates impact factor as a metric for ranking the quality of journal outlets for operations management (OM) research. We review all prior studies that assessed journal outlets for OM research and compare all previous OM journal quality rankings to rankings based on impact factors. We find that rankings based on impact factors that use data from different time periods are highly correlated and provide similar rankings of journals using either two‐year or five‐year assessment periods, either with or without self‐citations. However, some individual journals have large rank changes using different impact factor specifications. We also find that OM journal rankings based on impact factors are only moderately correlated with journal quality rankings previously determined using other methods, and the agreement among these other methods in ranking the quality of OM journals is relatively modest. Thus, impact factor rankings alone are not a replacement for the assessment methods used in previous studies, but rather they evaluate OM journals from another perspective.

Key concepts: Impact factor, Ranking (information retrieval), Journal ranking, Metric (unit), Rank (graph theory), Citation, Quality (philosophy), Perspective (graphical)

Related papers

Back to paper searchBrowse research topicsOriginal source
Impact factor as a metric to assess journals where OM research is published — Research Paper | ScholarLens