2023British Journal of UrologyOpen access

Methodological rigour in preclinical urology: a systematic review reporting research quality over a 14‐year period

Seung Hyun Park, Se Bee Lee, Seoyeon Park, Eun Young Kim, Damiano Pizzol, Mike Trott, Yvonne Barnett, Ai Koyanagi, Louis Jacob, Pınar Soysal, Nicola Veronese, Simona Ippoliti, Ramy Abou Ghayda, Nannan Thirumavalavan, Adonis Hijaz, David Sheyn, Rachel Pope, Britt Conroy, Irina Jaeger, Shubham Gupta, Amihay Nevo, Petre Cristian Ilie, Seung Won Lee, Dong Keon Yon, Hyun Ho Han, Sung Hwi Hong, Jae Il Shin, Lee Ponsky, Lee Smith

Open full text 4 citations

Abstract

OBJECTIVE: To investigate the prevalence and trends of essential study design elements in preclinical urological studies, as well as key factors that may improve methodological rigour, as the demand for methodological rigour in preclinical studies is increasing since research reproducibility and transparency in the medico-scientific field are being questioned. METHODS AND RESULTS: PubMed was searched to include preclinical urological studies published between July 2007 to June 2021. A total of 3768 articles met the inclusion criteria. Data on study design elements and animal models used were collected. Citation density was also examined as a surrogate marker of study influence. We performed an analysis of the prevalence of seven critical study design elements and temporal patterns over 14 years. Randomisation was reported in 50.0%, blinding in 15.0%, sample size estimation in 1.0%, inclusion of both sexes in 6.3%, statistical analysis in 97.1%, housing and husbandry in 47.7%, and inclusion/exclusion criteria in 5.0%. Temporal analysis showed that the implementation of these study design elements has increased, except for inclusion of both sexes and inclusion/exclusion criteria. Reporting study design elements were associated with increased citation density in randomisation and statistical analysis. CONCLUSIONS: The risk of bias is prevalent in 14-year publications describing preclinical urological research, and the quality of methodological rigour is barely related to the citation density of the article. Yet five study design elements (randomisation, blinding, sample size estimation, statistical analysis, and housing and husbandry) proposed by both the National Institutes of Health and Animal Research: Reporting of In Vivo Experiments guidelines have been either well reported or are being well reported over time. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42022233125.

About this research paper

What this paper is about

OBJECTIVE: To investigate the prevalence and trends of essential study design elements in preclinical urological studies, as well as key factors that may improve methodological rigour, as the demand for methodological rigour in preclinical studies is increasing since research reproducibility and transparency in the medico-scientific field are being questioned. METHODS AND RESULTS: PubMed was searched to include preclinical urological studies published between July 2007 to June 2021. A total of 3768 articles met the inclusion criteria. Data on study design elements and animal models used were collected. Citation density was also examined as a surrogate marker of study influence. We performed an analysis of the prevalence of seven critical study design elements and temporal patterns over 14 years. Randomisation was reported in 50.0%, blinding in 15.0%, sample size estimation in 1.0%, inclusion of both sexes in 6.3%, statistical analysis in 97.1%, housing and husbandry in 47.7%, and inclusion/exclusion criteria in 5.0%. Temporal analysis showed that the implementation of these study design elements has increased, except for inclusion of both sexes and inclusion/exclusion criteria. Reporting study design elements were associated with increased citation density in randomisation and statistical analysis. CONCLUSIONS: The risk of bias is prevalent in 14-year publications describing preclinical urological research, and the quality of methodological rigour is barely related to the citation density of the article. Yet five study design elements (randomisation, blinding, sample size estimation, statistical analysis, and housing and husbandry) proposed by both the National Institutes of Health and Animal Research: Reporting of In Vivo Experiments guidelines have been either well reported or are being well reported over time. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42022233125.

Why it matters

OpenAlex reports 4 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

OBJECTIVE: To investigate the prevalence and trends of essential study design elements in preclinical urological studies, as well as key factors that may improve methodological rigour, as the demand for methodological rigour in preclinical studies is increasing since research reproducibility and transparency in the medico-scientific field are being questioned. METHODS AND RESULTS: PubMed was searched to include preclinical urological studies published between July 2007 to June 2021. A total of 3768 articles met the inclusion criteria. Data on study design elements and animal models used were collected. Citation density was also examined as a surrogate marker of study influence. We performed an analysis of the prevalence of seven critical study design elements and temporal patterns over 14 years. Randomisation was reported in 50.0%, blinding in 15.0%, sample size estimation in 1.0%, inclusion of both sexes in 6.3%, statistical analysis in 97.1%, housing and husbandry in 47.7%, and inclusion/exclusion criteria in 5.0%. Temporal analysis showed that the implementation of these study design elements has increased, except for inclusion of both sexes and inclusion/exclusion criteria. Reporting study design elements were associated with increased citation density in randomisation and statistical analysis. CONCLUSIONS: The risk of bias is prevalent in 14-year publications describing preclinical urological research, and the quality of methodological rigour is barely related to the citation density of the article. Yet five study design elements (randomisation, blinding, sample size estimation, statistical analysis, and housing and husbandry) proposed by both the National Institutes of Health and Animal Research: Reporting of In Vivo Experiments guidelines have been either well reported or are being well reported over time. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42022233125.

Key concepts: Rigour, Blinding, Inclusion and exclusion criteria, Research design, Clinical study design, Medicine, Sample size determination, Inclusion (mineral)

Related papers

Back to paper searchBrowse research topicsOriginal source
Methodological rigour in preclinical urology: a systematic review reporting research quality over a 14‐year period — Research Paper | ScholarLens