← Back to course
2/6
Week 12 Β· The AI Review Board

Tuesday

Seeing inside the system
// Review, refine and present
⏱ about 20 min

Tuesday: Seeing Inside the System

A visitor from the telescope team asks the board a sharp question. "Why did Sky Sorter call my snapshot a comet?"

Rocket shrugs. "Because Sky Sorter said so?"

Raven shakes her head. "That is not an answer. We can do better."

Nova lights up Sky Sorter's version 3 decision tree on the wall. "Follow the path," she says. "Streak? No. Size 7 or more? Yes. Comet."

The visitor nods. "So I can see how it decided. And comet means I should watch for it again tomorrow."

Rocket looks impressed. "So how it works and what it means are two different questions."

Four big words

Transparency is how much information about an AI system and its outputs is available to the people using it.

That matters even when people do not know they are using AI.

Accountability means someone is responsible for the system. Accountability depends on transparency.

Explainability is about how a system works. Interpretability is about what its output means for its job.

WordQuestion it answersSky Sorter example
TransparencyWhat can users find out about it?A sign says Sky Sorter is a paper classifier made by the crew.
AccountabilityWho is responsible?Raven signs off on every new version.
ExplainabilityHow does it work?The decision tree path shows each step.
InterpretabilityWhat does the output mean for the job?Comet means: watch for it again tomorrow.
WHICH WORD?
  • Read the question.
  • Tap your answer.
The visitor follows the decision tree path to see how Sky Sorter decided. Which word?
A label "satellite streak" tells the team to ignore that snapshot. Which word?
A note on every report names the person responsible for Sky Sorter. Which word?
StatementTrue or false?
Accountability depends on transparency.?
Transparency only matters if people know they are using AI.?
Explainability is about how a system works.?
"Because the AI said so" is a full explanation.?
WHY THIS EXERCISEPeople deserve to see how a system works, what its outputs mean, and who is responsible.
Which word means someone is responsible for an AI system? Type one word.
WHY THIS EXERCISEAccountability means someone answers for the system, and it depends on transparency.
FOLLOW SKY SORTER'S COMET PATH
  • ?Streak? No.
  • ?Start with the snapshot's feature row.
  • ?Label: comet.
  • ?Size 7 or more? Yes.
WHY THIS EXERCISEA decision tree can be explained by following its path, one question at a time.
How a system works: explain____.
What can users find out about a system? That is trans____.

Clear thinking. Tomorrow the board runs its full review in the Explorer Lab.

← Monday