Sampling Methods and Sample Size

From Population to Sample — How Many and Who?

Learning Objectives

  1. Distinguish target, accessible, and study populations
  2. Choose among SRS, systematic, stratified, cluster, and multi-stage sampling
  3. Recognize when non-probability sampling is acceptable
  4. Explain sampling error, standard error, and the √n law
  5. Calculate sample size for estimating a proportion
  6. Calculate sample size for comparing two means or proportions
  7. Adjust for dropouts, clustering, and design effect

Clinical Hook: Sampling 1.4 Billion People

ICMR COVID-19 Serosurvey (2020):

  • Goal: Estimate seroprevalence in India
  • Population: 1.4 billion people
  • Sample: 29,000 individuals
  • Ratio: 1 in 48,000

Two fundamental questions:

  1. Who to sample? → Sampling methods
  2. How many to sample? → Sample size determination

How can 29,000 people represent 1.4 billion?

Part I: Sampling Methods

Simple Random Sampling (SRS)

Every individual has an equal probability of selection.

  • Use random number table or computer generator
  • Gold standard for unbiased selection
  • Requires a complete sampling frame (list of all individuals)

When to use:

  • Small, well-defined populations
  • Complete sampling frame available

Limitation:

  • Impractical for large/geographically dispersed populations
  • May miss small subgroups

Systematic Sampling

Select every k-th individual from the frame.

  1. Calculate interval: k = N/n
  2. Pick random start (1 to k)
  3. Select every k-th person thereafter

Example (NFHS):

  • 500 households in a village, need 50
  • k = 500/50 = 10
  • Random start = 3
  • Select: 3, 13, 23, 33, …

Advantage: Simpler than SRS, spreads evenly

Risk: Periodicity bias (if list has hidden pattern)

Stratified Sampling

Divide population into strata, sample from each.

  1. Define strata (age groups, districts, urban/rural)
  2. Sample independently within each stratum
  3. Can use proportional or disproportional allocation

Why stratify?

  • Ensures representation of all subgroups
  • Reduces sampling error (more homogeneous within strata)
  • Enables stratum-specific estimates

Example (NFHS-5):

  • Strata: Urban vs Rural within each state
  • Sample proportionally from each

Cluster Sampling

Randomly select whole clusters, sample everyone within.

  1. Divide population into clusters (villages, schools, PHCs)
  2. Randomly select clusters
  3. Include all individuals in selected clusters

Why use clusters?

  • No need for complete individual-level frame
  • Cheaper — travel to fewer locations
  • Standard for WHO EPI surveys

Disadvantage:

  • Higher sampling error (individuals within clusters are similar)
  • Need design effect correction for sample size

Multi-Stage Sampling

The real-world approach — used by NFHS and ICMR.

Each stage introduces sampling error — multi-stage designs require larger samples than SRS to achieve the same precision.

Sampling Methods: Summary

Method How It Works Best For Precision
Simple Random Random selection from complete list Small well-defined populations High
Systematic Every k-th person from list Large lists without subgroups High
Stratified Divide into strata, sample each Ensuring subgroup representation Highest
Cluster Select whole clusters, sample all within Large geographic spread, no frame Lower
Multi-Stage Hierarchical selection at multiple levels National surveys (NFHS, ICMR) Lower

Non-Probability Sampling

Method How When Acceptable Risk
Convenience Whoever is available Pilot studies, feasibility Selection bias
Purposive Researcher selects specific cases Qualitative, rare diseases Not generalizable
Snowball Participants recruit others Hidden populations (MSM, PWID) Network bias
Quota Fill predefined categories Market research, quick surveys Subjective selection

Key rule: Non-probability sampling cannot support statistical inference (no valid CIs or p-values). Use only when probability sampling is impossible.

Part II: Sampling Error & Sample Size

The Standard Error (SE)

SE quantifies typical sampling error.

\[SE_{\bar{x}} = \frac{\sigma}{\sqrt{n}}\]

\[SE_{\hat{p}} = \sqrt{\frac{p(1-p)}{n}}\]

Key insight (CLT):

  • Sampling error is random and follows a normal distribution
  • SE decreases with √n — the √n law
  • Doubling precision requires 4× the sample size

Margin of Error and Confidence Intervals

Margin of Error (MOE) = how far our estimate might be from the truth.

\[MOE = z_{\alpha/2} \times SE\]

For 95% confidence: MOE = 1.96 × SE

Example: HbA1c in 64 diabetic patients, mean = 11.5, SD = 1.6

  • SE = 1.6 / √64 = 0.2
  • MOE = 1.96 × 0.2 = 0.39 g/dL
  • 95% CI: 11.5 ± 0.39 = (11.11, 11.89)

“We are 95% confident the true mean HbA1c is between 11.11 and 11.89 g/dL.”

Sample Size for Estimating a Proportion

\[n = \frac{z^2_{\alpha/2} \times p(1-p)}{E^2}\]

Where:

  • \(z_{\alpha/2}\) = 1.96 (for 95% CI)
  • \(p\) = expected proportion
  • \(E\) = desired margin of error

If p is unknown: Use p = 0.5 (maximizes sample size — conservative)

Worked Example:

Estimate diabetes prevalence in Bhopal.

  • Expected: p = 0.10 (10%)
  • Precision: E = 0.02 (±2%)
  • Confidence: 95% (z = 1.96)

\[n = \frac{1.96^2 \times 0.10 \times 0.90}{0.02^2}\]

\[n = \frac{3.8416 \times 0.09}{0.0004} = \frac{0.346}{0.0004}\]

\[\boxed{n = 864}\]

Type I and Type II Errors

The Four Outcomes

Reject H₀ Fail to Reject H₀
**H₀ TRUE** (No effect) ❌ **Type I Error (α)** False Positive P = 0.05 ✅ **Correct** True Negative P = 1 − α = 0.95
**H₀ FALSE** (Effect exists) ✅ **Correct** (Power) True Positive P = 1 − β = 0.80 ❌ **Type II Error (β)** False Negative P = 0.20

Key trade-off: Decreasing α increases β. Solution: increase sample size!

Convention: α = 0.05, β = 0.20 (Power = 80%)

Sample Size for Comparing Two Means

\[n_{per\ group} = \frac{2(z_{\alpha/2} + z_{\beta})^2 \times \sigma^2}{\delta^2}\]

Where:

  • \(z_{\alpha/2}\) = 1.96 (α = 0.05, two-tailed)
  • \(z_{\beta}\) = 0.84 (β = 0.20, power = 80%)
  • σ = common SD in both groups
  • δ = difference to detect

Worked Example:

New antihypertensive vs standard.

  • Detect: δ = 10 mmHg difference
  • SD: σ = 15 mmHg
  • Power: 80%, α = 0.05

\[n = \frac{2(1.96 + 0.84)^2 \times 15^2}{10^2}\]

\[= \frac{2 \times 7.84 \times 225}{100}\]

\[\boxed{n = 36 \text{ per group}}\]

Sample Size for Comparing Two Proportions

\[n = \frac{2(z_{\alpha/2} + z_{\beta})^2 \times [p_1(1-p_1) + p_2(1-p_2)]}{(p_2 - p_1)^2}\]

Where:

  • \(p_1\) = proportion in control group
  • \(p_2\) = proportion in treatment group

Worked Example:

TB cure rate: 70% → 85%.

\[n = \frac{2 \times 7.84 \times [0.70 \times 0.30 + 0.85 \times 0.15]}{(0.85 - 0.70)^2}\]

\[= \frac{2 \times 7.84 \times [0.21 + 0.1275]}{0.0225}\]

\[= \frac{2 \times 7.84 \times 0.3375}{0.0225}\]

\[\boxed{n \approx 94 \text{ per group}}\]

Power Curves

Part III: Practical Adjustments

Adjusting for Dropouts

Not all enrolled subjects complete the study. Adjust upward:

\[n_{adjusted} = \frac{n}{1 - \text{dropout rate}}\]

Example: TB drug trial needs 94 per group. Expected dropout = 15%.

\[n_{adjusted} = \frac{94}{1 - 0.15} = \frac{94}{0.85} \approx 111 \text{ per group}\]

Always report both: “We calculated n = 94 per group, inflated to 111 to account for 15% expected dropout.”

Design Effect for Cluster Sampling

Cluster sampling inflates variance because individuals within clusters are similar.

\[DE = 1 + (m - 1) \times \rho\]

Where:

  • m = cluster size
  • ρ = intracluster correlation (ICC)

\[n_{adjusted} = n_{SRS} \times DE\]

Example:

  • SRS sample size: 36 per group
  • Cluster size: m = 12 patients per PHC
  • ICC: ρ = 0.02

\[DE = 1 + (12 - 1) \times 0.02 = 1.22\]

\[n_{adjusted} = 36 \times 1.22 \approx 44 \text{ per group}\]

Key insight: Even small ICC (ρ = 0.02) with large clusters can substantially inflate required n.

Sample Size Decision Flowchart

Then adjust for: dropoutsdesign effectfinite population correction

Key Takeaways

  1. Probability sampling enables valid inference; non-probability does not
  2. Stratified sampling gives the highest precision; cluster trades precision for feasibility
  3. SE = σ/√n — the √n law means diminishing returns with larger samples
  4. Sample size depends on: desired precision, expected variability, effect size, α, and power
  5. For estimation: n = z²p(1−p)/E² (proportions) or n = z²σ²/E² (means)
  6. For comparison: also need effect size (δ) and power (1−β)
  7. Always adjust for dropouts (inflate by 1/(1−dropout)) and clustering (multiply by DE)
  8. Calculate sample size BEFORE the study — underpowered studies are unethical

Formula Quick Reference

Purpose Formula Key Inputs
Estimate proportion \(n = z^2 p(1-p) / E^2\) p, margin of error
Estimate mean \(n = z^2 \sigma^2 / E^2\) σ, margin of error
Compare two means \(n = 2(z_\alpha + z_\beta)^2 \sigma^2 / \delta^2\) σ, effect size, power
Compare two proportions See formula above p₁, p₂, power
Dropout adjustment \(n_{adj} = n / (1 - d)\) dropout rate
Design effect \(DE = 1 + (m-1)\rho\) cluster size, ICC

Remember: z₀.₀₂₅ = 1.96 (95% CI) • z₀.₂₀ = 0.84 (80% power) • z₀.₁₀ = 1.28 (90% power)