Katana VentraIP

Sample size determination

Sample size determination or estimation is the act of choosing the number of observations or replicates to include in a statistical sample. The sample size is an important feature of any empirical study in which the goal is to make inferences about a population from a sample. In practice, the sample size used in a study is usually determined based on the cost, time, or convenience of collecting the data, and the need for it to offer sufficient statistical power. In complex studies, different sample sizes may be allocated, such as in stratified surveys or experimental designs with multiple treatment groups. In a census, data is sought for an entire population, hence the intended sample size is equal to the population. In experimental design, where a study may be divided into different treatment groups, there may be different sample sizes for each group.

Sample sizes may be chosen in several ways:

The desired of the trial, shown in column to the left.

statistical power

(= effect size), which is the expected difference between the means of the target values between the experimental group and the control group, divided by the expected standard deviation.

Cohen's d

Qualitative research[edit]

Qualitative research approaches sample size determination with a distinctive methodology that diverges from quantitative methods. Rather than relying on predetermined formulas or statistical calculations, it involves a subjective and iterative judgment throughout the research process In qualitative studies, researchers often adopt a subjective stance, making determinations as the study unfolds. Sample size determination in qualitative studies takes a different approach. It is generally a subjective judgment, taken as the research proceeds.[13] One common approach is to continually include additional participants or materials until a point of "saturation" is reached. Saturation occurs when new participants or data cease to provide fresh insights, indicating that the study has adequately captured the diversity of perspectives or experiences within the chosen sample saturation is reached.[14] The number needed to reach saturation has been investigated empirically.[15][16][17][18]


Unlike quantitative research, qualitative studies face a scarcity of reliable guidance regarding sample size estimation prior to beginning the research. Imagine conducting in-depth interviews with cancer survivors, qualitative researchers may use data saturation to determine the appropriate sample size. If, over a number of interviews, no fresh themes or insights show up, saturation has been reached and more interviews might not add much to our knowledge of the survivor's experience. Thus, rather than following a preset statistical formula, the concept of attaining saturation serves as a dynamic guide for determining sample size in qualitative research. There is a paucity of reliable guidance on estimating sample sizes before starting the research, with a range of suggestions given.[16][19][20][21] In an effort to introduce some structure to the sample size determination process in qualitative research, a tool analogous to quantitative power calculations has been proposed. This tool, based on the negative binomial distribution, is particularly tailored for thematic analysis.[22][21]

Design of experiments

Engineering response surface example under

Stepwise regression

Cohen's h

Bartlett, J. E. II; Kotrlik, J. W.; Higgins, C. (2001). (PDF). Information Technology, Learning, and Performance Journal. 19 (1): 43–50.

"Organizational research: Determining appropriate sample size for survey research"

(1965). Survey Sampling. Wiley. ISBN 978-0-471-48900-9.

Kish, L.

Smith, Scott (8 April 2013). . Qualtrics. Retrieved 19 September 2018.

"Determining Sample Size: How to Ensure You Get the Correct Sample Size"

Israel, Glenn D. (1992). . University of Florida, PEOD-6. Retrieved 29 June 2019.

"Determining Sample Size"

Rens van de Schoot, Milica Miočević (eds.). 2020. . Routledge.

Small Sample Size Solutions (Open Access): A Guide for Applied Researchers and Practitioners

NIST: Selecting Sample Sizes

E122-07: Standard Practice for Calculating Sample Size to Estimate, With Specified Precision, the Average for a Characteristic of a Lot or Process

ASTM

A MATLAB script implementing Cochran's sample size formula