2021Journal of Orthopaedics Trauma and RehabilitationOpen access

Levels of evidence backing the AAOS clinical practice guidelines

Arjun K. Reddy, Jared Scott, Jake X. Checketts, Keith Fishbeck, Marshall Boose, Landon Stallings, Matt Vassar

Open full text 7 citations

Abstract

Purpose: The American Academy of Orthopaedic Surgeons produces clinical practice guidelines for the treatment of orthopedic injuries. We examined the strength of the evidence underlying these recommendations in order to answer the following questions: (1) Have AAOS work groups improved guideline creation practices to locate evidence to generate strong recommendations? (2) Is there variability in the available evidence based on anatomic site or stage of care? (3) Has the level of evidence supporting improved over time? Methods: Twenty-two current guidelines of the Academy were examined which yielded 408 individual recommendations. These recommendations were assigned one of five strength of evidence ratings (strong, moderate, limited, inconclusive, consensus) by the guideline panel, based on the availability and quality of the supporting evidence. From these guidelines, we extracted all of the recommendations and their corresponding evidence ratings. We then classified the recommendations by stage of care, year, and anatomical site. Results: The distribution of the levels of evidence was as follows: 77 (18.9%) were based on consensus; 53 (13.0%) were inconclusive; 93 (22.8%) were based on limited evidence; 112 (27.5%) were based on moderate evidence; and 73 were based on (17.9%) strong evidence. Strong strength of evidence was found in 45.2% of the recommendations for preventive/screening/diagnostic care, 41.1% of nonsurgical treatment, 45.1% of surgical treatment, 51.1% of rehabilitation/postoperative treatment, and 45.5% of the recommendations that had mixed stages of care. Inconclusive strength of evidence was found to be prevalent from 2009–2013, but was eliminated starting in 2014. Conclusions: Only 73 (17.9%) recommendations generated by the Academy in its 22 clinical practice guidelines are based on a “strong” strength of evidence. More robust research is needed in orthopedics to bolster confidence in the recommendations in future guideline updates.

Open-access reader

About this research paper

What this paper is about

Purpose: The American Academy of Orthopaedic Surgeons produces clinical practice guidelines for the treatment of orthopedic injuries. We examined the strength of the evidence underlying these recommendations in order to answer the following questions: (1) Have AAOS work groups improved guideline creation practices to locate evidence to generate strong recommendations? (2) Is there variability in the available evidence based on anatomic site or stage of care? (3) Has the level of evidence supporting improved over time? Methods: Twenty-two current guidelines of the Academy were examined which yielded 408 individual recommendations. These recommendations were assigned one of five strength of evidence ratings (strong, moderate, limited, inconclusive, consensus) by the guideline panel, based on the availability and quality of the supporting evidence. From these guidelines, we extracted all of the recommendations and their corresponding evidence ratings. We then classified the recommendations by stage of care, year, and anatomical site. Results: The distribution of the levels of evidence was as follows: 77 (18.9%) were based on consensus; 53 (13.0%) were inconclusive; 93 (22.8%) were based on limited evidence; 112 (27.5%) were based on moderate evidence; and 73 were based on (17.9%) strong evidence. Strong strength of evidence was found in 45.2% of the recommendations for preventive/screening/diagnostic care, 41.1% of nonsurgical treatment, 45.1% of surgical treatment, 51.1% of rehabilitation/postoperative treatment, and 45.5% of the recommendations that had mixed stages of care. Inconclusive strength of evidence was found to be prevalent from 2009–2013, but was eliminated starting in 2014. Conclusions: Only 73 (17.9%) recommendations generated by the Academy in its 22 clinical practice guidelines are based on a “strong” strength of evidence. More robust research is needed in orthopedics to bolster confidence in the recommendations in future guideline updates.

Why it matters

OpenAlex reports 7 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Purpose: The American Academy of Orthopaedic Surgeons produces clinical practice guidelines for the treatment of orthopedic injuries. We examined the strength of the evidence underlying these recommendations in order to answer the following questions: (1) Have AAOS work groups improved guideline creation practices to locate evidence to generate strong recommendations? (2) Is there variability in the available evidence based on anatomic site or stage of care? (3) Has the level of evidence supporting improved over time? Methods: Twenty-two current guidelines of the Academy were examined which yielded 408 individual recommendations. These recommendations were assigned one of five strength of evidence ratings (strong, moderate, limited, inconclusive, consensus) by the guideline panel, based on the availability and quality of the supporting evidence. From these guidelines, we extracted all of the recommendations and their corresponding evidence ratings. We then classified the recommendations by stage of care, year, and anatomical site. Results: The distribution of the levels of evidence was as follows: 77 (18.9%) were based on consensus; 53 (13.0%) were inconclusive; 93 (22.8%) were based on limited evidence; 112 (27.5%) were based on moderate evidence; and 73 were based on (17.9%) strong evidence. Strong strength of evidence was found in 45.2% of the recommendations for preventive/screening/diagnostic care, 41.1% of nonsurgical treatment, 45.1% of surgical treatment, 51.1% of rehabilitation/postoperative treatment, and 45.5% of the recommendations that had mixed stages of care. Inconclusive strength of evidence was found to be prevalent from 2009–2013, but was eliminated starting in 2014. Conclusions: Only 73 (17.9%) recommendations generated by the Academy in its 22 clinical practice guidelines are based on a “strong” strength of evidence. More robust research is needed in orthopedics to bolster confidence in the recommendations in future guideline updates.

Key concepts: Guideline, Medicine, Evidence-based medicine, Evidence-based practice, Rehabilitation, Orthopedic surgery, Quality of evidence, MEDLINE

Related papers

Back to paper searchBrowse research topicsOriginal source
Levels of evidence backing the AAOS clinical practice guidelines — Research Paper | ScholarLens