2021•Black Sea Journal of Health ScienceOpen access

Sample Size in Clinical Researches: Power of the Test and Effect Size

Adnan Ünalan

Open full text 11 citations

Abstract

The approval of local ethics committees is required for clinical researches. In order to obtain approval, how the sample size is determined, whether power analysis is done or not and under what assumptions these analyses are made, are important questions/problems. In hypothesis tests, it is possible two types of errors (type 1 error denoted by α and type 2 error denoted by β), of which α is the probability of rejecting the null hypothesis that is actually true and is the probability of accepting the actually false null hypothesis. These errors also determine the reliability of the test (1-α) and the power of test (1-β). While α is directly determined by the researchers and generally as taken 0.05 (in some cases 0.01), β cannot be determined directly. Because β, hence the power of test (1-β) depends on the α (negatively correlated with β) the variation in the population (positively correlated with β) and sample size (n; negatively correlated with β). In clinical researches, it is required that β does not exceed 0.10 (in some cases 0.05) so the power of test should be at least 0.90 and above. In this study, the sample sizes required for some statistical tests (independent sample t-test, one-way ANOVA and Chi-square) which are widely used in clinical research, were calculated with the G*Power program and some evaluations were made. As a result, as expected in the statistical tests, it was observed that decreasing both α and effect size and increasing the power of the test significantly increased the required sample size. However, it was also observed that increasing effect on the sample size of increasing the power of test decreased (5-11%) in the smaller values of α in the independent sample t-test, decreased (nearly 5%) when increasing the number of compared groups in one-way ANOVA and decreased (10-15%) when increasing degree of freedom of Chi-square test.

Open-access reader

About this research paper

What this paper is about

The approval of local ethics committees is required for clinical researches. In order to obtain approval, how the sample size is determined, whether power analysis is done or not and under what assumptions these analyses are made, are important questions/problems. In hypothesis tests, it is possible two types of errors (type 1 error denoted by α and type 2 error denoted by β), of which α is the probability of rejecting the null hypothesis that is actually true and is the probability of accepting the actually false null hypothesis. These errors also determine the reliability of the test (1-α) and the power of test (1-β). While α is directly determined by the researchers and generally as taken 0.05 (in some cases 0.01), β cannot be determined directly. Because β, hence the power of test (1-β) depends on the α (negatively correlated with β) the variation in the population (positively correlated with β) and sample size (n; negatively correlated with β). In clinical researches, it is required that β does not exceed 0.10 (in some cases 0.05) so the power of test should be at least 0.90 and above. In this study, the sample sizes required for some statistical tests (independent sample t-test, one-way ANOVA and Chi-square) which are widely used in clinical research, were calculated with the G*Power program and some evaluations were made. As a result, as expected in the statistical tests, it was observed that decreasing both α and effect size and increasing the power of the test significantly increased the required sample size. However, it was also observed that increasing effect on the sample size of increasing the power of test decreased (5-11%) in the smaller values of α in the independent sample t-test, decreased (nearly 5%) when increasing the number of compared groups in one-way ANOVA and decreased (10-15%) when increasing degree of freedom of Chi-square test.

Why it matters

OpenAlex reports 11 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

The approval of local ethics committees is required for clinical researches. In order to obtain approval, how the sample size is determined, whether power analysis is done or not and under what assumptions these analyses are made, are important questions/problems. In hypothesis tests, it is possible two types of errors (type 1 error denoted by α and type 2 error denoted by β), of which α is the probability of rejecting the null hypothesis that is actually true and is the probability of accepting the actually false null hypothesis. These errors also determine the reliability of the test (1-α) and the power of test (1-β). While α is directly determined by the researchers and generally as taken 0.05 (in some cases 0.01), β cannot be determined directly. Because β, hence the power of test (1-β) depends on the α (negatively correlated with β) the variation in the population (positively correlated with β) and sample size (n; negatively correlated with β). In clinical researches, it is required that β does not exceed 0.10 (in some cases 0.05) so the power of test should be at least 0.90 and above. In this study, the sample sizes required for some statistical tests (independent sample t-test, one-way ANOVA and Chi-square) which are widely used in clinical research, were calculated with the G*Power program and some evaluations were made. As a result, as expected in the statistical tests, it was observed that decreasing both α and effect size and increasing the power of the test significantly increased the required sample size. However, it was also observed that increasing effect on the sample size of increasing the power of test decreased (5-11%) in the smaller values of α in the independent sample t-test, decreased (nearly 5%) when increasing the number of compared groups in one-way ANOVA and decreased (10-15%) when increasing degree of freedom of Chi-square test.

Key concepts: Sample size determination, Type I and type II errors, Statistics, Statistical power, Null hypothesis, Mathematics, Sample (material), Statistical hypothesis testing

Related papers

Back to paper searchBrowse research topicsOriginal source
Sample Size in Clinical Researches: Power of the Test and Effect Size — Research Paper | ScholarLens