← Back to course
1/6
Week 07 Β· Three Kinds of Bias

Monday

A good score with a hidden gap
// When a fair-looking score hides a gap
⏱ about 20 min

Monday: A Good Score with a Hidden Gap

After the camera change, the crew retrained Sky Sorter on a new box of forty labeled cards.

Rocket pins the results of a bigger test, twenty fresh cards, to the mission board. "15 out of 20 right! That is a great score."

Raven runs her finger down the results table. Then she stops at the bottom rows.

"Look at the comets," she says quietly. "Two comet cards in the test, and Sky Sorter missed both."

Rocket frowns. "But nobody told it to ignore comets. We never meant to be unfair."

Nova hovers beside the board, her lights pulsing slowly. "Meaning to be unfair and being unfair are different things," she says.

"What if the problem started before Sky Sorter ever saw a test card?"

What is bias?

In everyday talk, bias means leaning toward one side. In AI, bias is a steady lean that makes results unfair or wrong for some cases.

Bias is not the same as a random mistake. A random mistake could land anywhere. Bias keeps landing in the same place.

Sky Sorter missed both comets. That is a pattern, not bad luck, so it is worth a closer look.

Three kinds, named by NIST

NIST, the US National Institute of Standards and Technology, wrote a framework for managing the risks of AI.

It names three major kinds of AI bias: systemic, computational and statistical, and human-cognitive.

It also says each kind can happen without anyone meaning to be unfair.

This week you will meet all three and find each one hiding in Sky Sorter.

  • Systemic bias: in datasets, in a group's habits and processes, and in the wider society that uses AI.
  • Computational and statistical bias: in datasets and algorithms, often from samples that leave some cases out.
  • Human-cognitive bias: in how people read an AI system's output, fill in gaps, or think about what it is for.
BIAS OR RANDOM MISTAKE?
  • Read the question.
  • Tap your answer.
Sky Sorter misses one star card out of eight, and the miss looks like any other star. Is that clearly bias?
Sky Sorter misses every comet card it is shown. What does that suggest?
Can bias happen even when nobody meant to be unfair?
StatementTrue or false?
NIST names three major kinds of AI bias.?
Bias only happens when someone wants to be unfair.?
A high overall score proves a model works well for every kind of case.?
Human-cognitive bias is about how people read and use an AI system's output.?
WHY THIS EXERCISEBias can hide inside a good overall score, and it can happen without unfair intent.
How many major kinds of AI bias does NIST name? Type a number.
WHY THIS EXERCISENIST names three: systemic, computational and statistical, and human-cognitive.
Try it
Think of a game score that looked great but hid a weak spot.
Maybe you won a match but lost every point on one side of the court.
Write one sentence about what the overall score hid.

Strong start, explorer. Tomorrow you open the training box and count what is inside.