← Back to course
3/6
Week 11 Β· Bias, Access and Many Voices

Wednesday

Count Lab: The bias audit
// Whose voices are in our data, and whose are missing?
⏱ about 20 min

Wednesday: Count Lab: The Bias Audit

Count Lab day. Keeper Ines lends the crew the Commons sign-in book.

"Every member writes down when they usually visit," she says. "All 120 of them."

Comet sets the book next to the survey totals. "Evening got 15 answers. Morning got only 8."

Wren runs a finger down both columns. "What do you notice? There are more evening members, but not that many more."

Nova hovers over the table and projects a dotted line. "Would you like a hint?" she asks. "Forty answers from 120 members is one in three. What if every group answered at that rate?"

Comet picks up a pencil. "Then we can see who was over-heard and who was under-heard."

Your mission

You will compare who answered with who belongs. Then you will plan fixes for the groups the survey under-heard.

A group's fair share is the number of answers it would give at the overall rate. Here that rate is one in three.

  • A pencil and paper
  • Graph paper, or lined paper and a ruler
  • Two colored pencils (optional)
  1. Copy the table below onto paper.
  2. For each group, divide its members in the sign-in book by 3. Write that number as the fair share.
  3. Check that the four fair shares add up to 40.
  4. For each group, subtract the fair share from the real answers. Write the difference.
  5. A plus number means over-heard. A minus number means under-heard. Zero means just right.
  6. Circle the most over-heard group and the most under-heard group.
  7. Write one fix for each under-heard group.
Usual visit timeMembers (sign-in book)Answers (Q2)Fair share (members divided by 3)Difference
Morning308(you work it out)(you work it out)
Afternoon3010(you work it out)(you work it out)
Evening3615(you work it out)(you work it out)
Weekend247(you work it out)(you work it out)
Total (made-up data from the Commons Count story)12040400
CHECK YOUR AUDIT
  • Read the question.
  • Tap your answer.
What is the evening group's fair share?
Which group answered more than its fair share?
Which group is the most under-heard?
Which group answered exactly its fair share?
Audit findingTrue or false?
The four fair shares add up to 40.?
Weekend members gave 1 fewer answer than their fair share.?
The audit shows the survey heard every group equally.?
WHY THIS EXERCISEAn audit turns a feeling about fairness into numbers you can check.

Plan the fixes

Wren reminds the crew: if the people picked for a sample could simply drop out, the sample would quickly become less valid.

So the fix is to reach the under-heard groups, not to collect extra evening answers.

Collaboration that includes diverse perspectives helps avoid bias. Ask morning and weekend members how they would like to be asked.

PICK THE BEST FIX
  • Read the question.
  • Tap your answer.
Which fix best reaches morning members?
Which fix best reaches weekend members?
On graph paper, draw a bar graph with two bars for each visit time: fair share and real answers. Start the y-axis at 0 and add a title.

Careful, fair work, data analyst. Tomorrow you will meet projects that gather many voices at once.

← Tuesday