Concept Lesson

Sampling Bias: Undercoverage, Nonresponse, and Response Bias

A lesson in sampling and response bias that moves from intuition and definitions to worked reasoning, error correction, and independent practice.

Course status: Revised 2026-27 course
Updated: July 18, 2026
Practice: Easy, Tough and Toughest

Lesson Goals: Sampling Bias

Bias is a systematic tendency of a method, so increasing sample size reduces random variability but does not repair undercoverage, nonresponse, response bias, or misleading wording.

Reader taskundercoverage, nonresponse, response bias, wording, convenience, and voluntary response

Planned modules8

Mathematics1 expressions

Worked checks48

Boundary: Random selection addresses sampling variability but does not repair every measurement flaw.

Bias versus variability

Bias versus variability in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Bias versus variability in sampling bias, Design or critique a sampling plan for a public-parks visitor survey that addresses bias versus variability.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Bias versus variability in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Bias versus variability in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Undercoverage

Undercoverage in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Undercoverage in sampling bias, Design or critique a sampling plan for a tutoring-program evaluation that addresses undercoverage.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Undercoverage in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Undercoverage in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Nonresponse

Nonresponse in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Nonresponse in sampling bias, Design or critique a sampling plan for a classroom memory study that addresses nonresponse.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Nonresponse in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Nonresponse in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Response bias

Response bias in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Response bias in sampling bias, Design or critique a sampling plan for a tutoring-program evaluation that addresses response bias.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Response bias in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Response bias in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Wording effects

Wording effects in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Wording effects in sampling bias, Design or critique a sampling plan for a seedling-growth comparison that addresses wording effects.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Wording effects in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Wording effects in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Voluntary response

Voluntary response in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Voluntary response in sampling bias, Design or critique a sampling plan for a school library checkout study that addresses voluntary response.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Voluntary response in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Voluntary response in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Convenience samples

Convenience samples in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Convenience samples in sampling bias, Design or critique a sampling plan for a city bus arrival investigation that addresses convenience samples.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Convenience samples in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Convenience samples in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Redesigning flawed samples

Redesigning flawed samples in sampling bias: Define the population and frame, use a chance mechanism, identify the selected units, and anticipate undercoverage, nonresponse, and measurement error. Random selection supports probability-based inference to the covered population; it does not guarantee a representative realized sample.

Worked reasoning

For Redesigning flawed samples in sampling bias, Design or critique a sampling plan for a commuter route study that addresses redesigning flawed samples.

For a systematic sample of 80 from a frame of 2,400, use interval

k=2400/80=30

, choose a random start from 1 through 30, then select every 30th unit.

When the idea is valid

For Redesigning flawed samples in sampling bias, The random mechanism must operate on units in a frame that adequately covers the target population.

Misconception to remove

For Redesigning flawed samples in sampling bias, reject this error: Selecting the first 80 convenient units is not systematic random sampling because there is no random start and fixed interval over the frame.

Formula and Notation Reference

Estimator bias

\text{bias}=E(\text{estimator})-\text{parameter}

Estimator bias in Sampling Bias: This expression belongs specifically to sampling and response bias; define every symbol and apply the scope rule for undercoverage, nonresponse, response bias, wording, convenience, and voluntary response before calculation.

AdvertisementGoogle AdSense before practice placement reserved here

Guided, Independent and Challenge Practice

Every question in Sampling Bias: Undercoverage, Nonresponse, and Response Bias is newly written from the revised framework and the logic visible in public College Board materials. Constructed numerical settings are identified as instructional scenarios and are never represented as measurements from a real population. No released or secure question wording is reproduced.

Easy Practice

Easy 1: Voluntary response

Question P37-Easy-1. Design or critique a sampling plan for a public-parks visitor survey that addresses voluntary response.