The Journal Impact Factor: Too Much of an Impact?
Tam Ha, Say Beng Tan, Khee Chee Soo
Abstract
Open-access reader
Tam Ha, Say Beng Tan, Khee Chee Soo
Abstract
Open-access reader
INTRODUCTION: The journal impact factor is often used to judge the scientific quality of individual research articles and individual journals. Despite numerous reviews in the literature criticising such use, in some countries the impact factor has become an outcome measure for grant applications, job applications, promotions and bonuses. The aim of this review is to highlight the major issues involved with using the journal impact factor as a measure of research quality. METHODS: A literature review of articles on journal impact factors, science citation index, and bibliometric methods was undertaken to identify relevant articles. RESULTS: The journal impact factor is a quantitative measure based on the ratio between yearly citations in a particular journal to total citations in that journal in the previous 2 years. Its use as a criterion for measuring the quality of research is biased. The major sources of bias include database problems from the Institute for Scientific Information and research field effects. The journal impact factor, originally designed for purposes other than the individual evaluation of research quality, is a useful tool provided its interpretation is not extrapolated beyond its limits of validity. CONCLUSION: Research quality cannot be measured solely using the journal impact factor. The journal impact factor should be used with caution, and should not be the dominant or only factor determining research quality.
OpenAlex reports 90 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
INTRODUCTION: The journal impact factor is often used to judge the scientific quality of individual research articles and individual journals. Despite numerous reviews in the literature criticising such use, in some countries the impact factor has become an outcome measure for grant applications, job applications, promotions and bonuses. The aim of this review is to highlight the major issues involved with using the journal impact factor as a measure of research quality. METHODS: A literature review of articles on journal impact factors, science citation index, and bibliometric methods was undertaken to identify relevant articles. RESULTS: The journal impact factor is a quantitative measure based on the ratio between yearly citations in a particular journal to total citations in that journal in the previous 2 years. Its use as a criterion for measuring the quality of research is biased. The major sources of bias include database problems from the Institute for Scientific Information and research field effects. The journal impact factor, originally designed for purposes other than the individual evaluation of research quality, is a useful tool provided its interpretation is not extrapolated beyond its limits of validity. CONCLUSION: Research quality cannot be measured solely using the journal impact factor. The journal impact factor should be used with caution, and should not be the dominant or only factor determining research quality.
Key concepts: Impact factor, Citation, Quality (philosophy), Medicine, Science Citation Index, Bibliometrics, Measure (data warehouse), Data science