Comet holds up a flyer she made as a test. "9 out of 10 runners love the new course!"
"Who was asked?" Wren says at once. "How were they picked? What exactly was the question?"
"My 10 friends at the finish," Comet admits. "And I asked, 'Isn't the new course great?'"
"Convenience sample, leading question, tiny sample," Wren says. "Three problems in one flyer. What do you notice?"
"The 90% is real arithmetic," Comet says. "But it tells us nothing about all 40 runners."
Nova projects a checklist beside the flyer. "Would you like a hint? Ask the same five questions of every report."
"Population, sample size, how picked, what asked, and what the number means," Wren says. "Every time."
Comet's flyer: population unclear, sample of 10, picked by convenience, a leading question, and a percent of friends only.
The crew's Monday survey: population all 40 runners, sample of 10, picked by the bag, a plain question, 60% of the sample.
Even the Monday survey is an estimate with wobble. A careful report says so.
| Report | Sample size | How picked | Question | Trust it? |
|---|---|---|---|---|
| Comet's flyer | 10 | friends at the finish | leading | no |
| Monday's survey | 10 | 10 tokens from 40 | neutral | yes, with wobble |
| A sheet at the water table | whoever writes | voluntary | neutral | no |
| Statement | True or false? |
|---|---|
| A percent from 10 friends tells you about all 40 runners. | ? |
| A careful report says how the sample was picked. | ? |
| 9 + 1 = 10 | ? |
| A random sample gives an estimate with some wobble, and a good report says so. | ? |
A critical reader. Tomorrow is Track Day: a random sample from your own shelf, and an estimate for the family.