← Back to course
5/6
Week 06 Β· Cleaning Data

Friday

Impact Friday: Who gets cleaned out?
// Fixing messy data without changing what it means
⏱ about 20 min

Friday: Impact Friday: Who Gets Cleaned Out?

Comet wants the report done by tonight. "Q6 is optional, and its answers fit no category. Let's delete the whole Q6 column."

Wren pulls the Q6 answers toward him. Most are blank. A few say thank you.

Then he stops at M22. He reads it aloud: "A ramp at the side door."

"What do you notice?" he asks quietly.

Comet reads it twice. "That is not on our list of four. But it matters. Someone cannot get in easily."

Nova hovers over the page. "Would you like a hint?" she asks. "Cleaning choices decide whose words reach the council."

Comet puts the eraser down. "We keep it. We just need a new place for it in the report."

Cleaning choices can hide voices

Computing innovations can reflect human biases through their data or their algorithms. Bias can enter at every level of the work.

Bias often comes from the type or source of the data collected. Collecting more data does not remove it.

Working with data is iterative. You filter and clean, look again, and sometimes go back to change a step.

If the crew had deleted Q6, nobody would know a member needs a ramp. More survey answers would not have fixed that.

ChoiceWhat the council would hear
Delete the Q6 columnFour categories only. The ramp request is gone.
Force M22's ramp into a Q3 categoryA wrong total, and the ramp request is hidden.
Keep Q6 and report it in its own sectionFour categories, plus one access need to look at.

These choices are part of the Commons Count story.

WHICH CHOICE IS FAIREST?
  • Read the question.
  • Tap your answer.
Which choice keeps every member's meaning and keeps the totals true?
Suppose the crew deleted Q6, then asked 40 more members. Would the ramp need show up?
Where could bias have entered Commons Count?
StatementTrue or false?
Bias can enter at every level of working with data.?
Collecting more data always removes bias.?
Deleting answers that fit no category is always safe.?
Data work is iterative: you may go back and change a step.?
WHY THIS EXERCISEKnowing where bias hides helps you protect the voices that are easiest to lose.

Week review

  1. Open-box answers are often not uniform: people spell, shorten and capitalize differently.
  2. Cleaning makes data uniform without changing meaning.
  3. Blank answers are marked blank and invalid answers are marked invalid. Nobody fills in a guess.
  4. A cleaning log records every choice so others can check it.
  5. Filter keeps some rows. Transform changes every item. Combine adds or compares.
  6. Cleaning choices can hide voices, so look before you delete.
ORDER THE CLEANING WORK
  • Tap a card.
  • Then tap its spot.
1First
2Next
3Then
4Last
WEEK CHECK
  • Read the question.
  • Tap your answer.
M37 wrote "bikes." After cleaning, what is it?
Dividing every visit count by 7 is which process?
On paper, sketch the council report's new section: a short heading and one line about the ramp request, with no member ID.

What a week, data analyst. Tomorrow is Mission Quest: sorting with rules your whole family agrees on.

← Thursday