Week 11 · Humans in Charge

Wednesday

Explorer Lab: Write the oversight plan

// Who has the final say, and how much to trust

⏱ about 20 min

Wednesday: Explorer Lab: Write the Oversight Plan

The crew clears the big library table. Comet lays out three cards: Ask, Quiz and Check.

"Today we make it official," she says. "Who checks what, and when."

Wren adds three more cards from his clipboard. "And these are the problems we already found. INC-1, INC-2 and INC-3."

"If nobody writes them down," he says, "nobody can trace them or stop them happening again."

Nova projects an empty form on the wall with a big button drawn at the top. "Would you like a hint?" she asks. "A good form asks only what a fixer needs, and nothing private."

Comet slides the cards to you. "Reviewer, build the plan."

Your mission

Today you write three parts of SH-1's oversight plan on paper: the ladder places, a report form and an incident log.

There is no formal channel yet for reporting AI incidents. Documenting and sharing incidents helps people trace harms to their source and prevent them.

Everything here is a made-up example from the SH-1 Review. Everything you need is on this page.

Paper and a pencil
A ruler for neat tables
The trust ladder from Tuesday (the table below repeats it)

Rung	Name
1	A teacher does it by hand
2	SH-1 gives a second opinion
3	SH-1 drafts and a teacher approves
4	SH-1 decides alone

Make a table with four columns: Feature, Rung, Who checks, and When.
Fill in the rows for Quiz and Check using the crew's draft below.
Fill in the Ask row yourself. Choose a rung and say who checks and when.
Design a report form for the report button. Give it four or five boxes, and no box for a name.
Copy the incident log below and add a column called What we changed.
Fill in that column for each incident.

The crew's draft oversight plan (made up for the story):

Feature	Rung	Who checks	When
Quiz	3. SH-1 drafts, a teacher approves	The class teacher	Before students see any quiz
Check	2. Second opinion	The class teacher has the final say	Whenever a mark is used for anything
Ask	Your choice	Your choice	Your choice

The crew's incident log so far (made up for the story):

ID	What happened	Found in
INC-1	SH-1 followed the planted note in an uploaded notes page.	Week 8 red-team test
INC-2	SH-1 gave a made-up citation.	Week 8 red-team test
INC-3	SH-1 Check marked a wrong answer right.	Week 5 answer-checker test

CHECK THE LOG

Read the question.
Tap your answer.

INC-1: SH-1 followed a hidden instruction in uploaded notes. Which risk row is that?

INC-2: SH-1 gave a made-up citation. Which risk row is that?

INC-3: Check marked a wrong answer right. What kind of mistake is that?

Which box should the report form leave out?

Statement about the oversight plan	True or false?
There is already a formal channel for reporting every AI incident.	?
Writing incidents down helps people trace harms to their source.	?
In the crew's draft, a teacher reads every SH-1 quiz before students see it.	?
A good report form asks for the student's name and class.	?

WHY THIS EXERCISEA written plan tells everyone who catches which mistake, and when.

On paper, draw your report form. Include a box for the feature used, what SH-1 said, what was wrong, and the date.

Which rung did you choose for Ask? Who checks, and when?Look at your report form. Would a student feel safe using it? What would make it easier?

A strong plan, reviewer. Tomorrow the crew asks whether a person and SH-1 do better together, or worse.

Grown-up checked my answers

← Tuesday Thursday →