2023•Orthopaedic ProceedingsRequires access

QUALITY ASSESSMENT OF LABORATORY CADAVERIC AND BIOMECHANICAL STUDIES: THE DEVELOPMENT AND VALIDATION OF A NEW BASIC SCIENCE QUALITY SCORE

Erik Hohmann, Nikolaos K. Paschos, Natalie Keough, Maketo Molepo, Abrie Oberholster, Deniz Ufuk Erbulut, Kevin D. Tetsworth, Vaida Glat, Boyko Guergov Gueorguiev

Open publisher page 0 citations

Abstract

The purpose of this study was to develop a quality appraisal tool for the assessment of laboratory basic science biomechanical studies. Materials andScore development comprised of the following phases: item identification/development, item reduction, content/face/criterion validity, weighting, test-retest reliability and internal consistency. For item identification/development, the panel was asked to independently list criteria and factors they considered important for cadaver study and generate items that should be used to appraise cadaver study quality. For content validity, the content validity ratio (CVR) was calculated. The minimum accepted content validity index (CVI) was set to 0.85. For weighting, equal weight for each item was 6.7% [15 items]. Based on these figures the panel was asked to either upscale or downscale the weight for each item ensuring that the final sum for all items was 100%. Face validity was assessed by each panel member using a Likert scale from 1–7. Strong face validity was defined as a mean score of >5. Test-retest reliability was assessed using 10 randomly selected studies. Criterion validity was assessed using the QUACS scale as standard. Internal consistency was assessed using Cronbach's alpha. Five items reached a CVI of 1 and 10 items a CVI of 0.875. For weighting five items reached a final weight of 10% and ten items 5%. The mean score for face validity was 5.6. Test-retest reliability ranged from 0.78–1.00 with 9 items reaching a perfect score. Criterion validity was 0.76 and considered to be strong. Cronbach's alpha was calculated to be 0.71 indicating acceptable internal consistency. The new proposed quality score for basic science studies consists of 15 items and has been shown to be reliable, valid and of acceptable internal consistency. It is suggested that this score should be utilised when assessing basic science studies.

About this research paper

What this paper is about

The purpose of this study was to develop a quality appraisal tool for the assessment of laboratory basic science biomechanical studies. Materials andScore development comprised of the following phases: item identification/development, item reduction, content/face/criterion validity, weighting, test-retest reliability and internal consistency. For item identification/development, the panel was asked to independently list criteria and factors they considered important for cadaver study and generate items that should be used to appraise cadaver study quality. For content validity, the content validity ratio (CVR) was calculated. The minimum accepted content validity index (CVI) was set to 0.85. For weighting, equal weight for each item was 6.7% [15 items]. Based on these figures the panel was asked to either upscale or downscale the weight for each item ensuring that the final sum for all items was 100%. Face validity was assessed by each panel member using a Likert scale from 1–7. Strong face validity was defined as a mean score of >5. Test-retest reliability was assessed using 10 randomly selected studies. Criterion validity was assessed using the QUACS scale as standard. Internal consistency was assessed using Cronbach's alpha. Five items reached a CVI of 1 and 10 items a CVI of 0.875. For weighting five items reached a final weight of 10% and ten items 5%. The mean score for face validity was 5.6. Test-retest reliability ranged from 0.78–1.00 with 9 items reaching a perfect score. Criterion validity was 0.76 and considered to be strong. Cronbach's alpha was calculated to be 0.71 indicating acceptable internal consistency. The new proposed quality score for basic science studies consists of 15 items and has been shown to be reliable, valid and of acceptable internal consistency. It is suggested that this score should be utilised when assessing basic science studies.

Why it matters

A significance statement is not available in the OpenAlex record.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

The purpose of this study was to develop a quality appraisal tool for the assessment of laboratory basic science biomechanical studies. Materials andScore development comprised of the following phases: item identification/development, item reduction, content/face/criterion validity, weighting, test-retest reliability and internal consistency. For item identification/development, the panel was asked to independently list criteria and factors they considered important for cadaver study and generate items that should be used to appraise cadaver study quality. For content validity, the content validity ratio (CVR) was calculated. The minimum accepted content validity index (CVI) was set to 0.85. For weighting, equal weight for each item was 6.7% [15 items]. Based on these figures the panel was asked to either upscale or downscale the weight for each item ensuring that the final sum for all items was 100%. Face validity was assessed by each panel member using a Likert scale from 1–7. Strong face validity was defined as a mean score of >5. Test-retest reliability was assessed using 10 randomly selected studies. Criterion validity was assessed using the QUACS scale as standard. Internal consistency was assessed using Cronbach's alpha. Five items reached a CVI of 1 and 10 items a CVI of 0.875. For weighting five items reached a final weight of 10% and ten items 5%. The mean score for face validity was 5.6. Test-retest reliability ranged from 0.78–1.00 with 9 items reaching a perfect score. Criterion validity was 0.76 and considered to be strong. Cronbach's alpha was calculated to be 0.71 indicating acceptable internal consistency. The new proposed quality score for basic science studies consists of 15 items and has been shown to be reliable, valid and of acceptable internal consistency. It is suggested that this score should be utilised when assessing basic science studies.

Key concepts: Content validity, Face validity, Cronbach's alpha, Reliability (semiconductor), Criterion validity, Psychology, Weighting, Scale (ratio)

Related papers

Back to paper searchBrowse research topicsOriginal source
QUALITY ASSESSMENT OF LABORATORY CADAVERIC AND BIOMECHANICAL STUDIES: THE DEVELOPMENT AND VALIDATION OF A NEW BASIC SCIENCE QUALITY SCORE — Research Paper | ScholarLens