← Back to course
AI and You 9-12 / Week 12 / Friday
5/6
Week 12 · People of AI and the Final Review

Friday

Impact Friday: The panel decides
// Who does the work of AI, and should Harbor Point pilot SH-1?
⏱ about 20 min

Friday: Impact Friday: The Panel Decides

At 3 pm the Tech Review Panel gathers around the library's long table. Librarian Joss nods to the crew. "Whenever you are ready."

Comet stands first. "Twelve weeks ago I wanted to approve SH-1 on the spot. I was wowed by a 92. Then we tested it ourselves."

Wren holds up the register. "The evidence says SH-1 helps in Biology and Algebra, and is not ready for Spanish. So we recommend go, with eight conditions."

Nova projects the conditions for everyone to see, then dims her lights and waits.

The panel talks quietly. Then every hand goes up. "Yes to the conditional pilot," says Librarian Joss.

Comet and Wren turn to you, grinning. "Reviewer, we did it together."

The decision

The panel votes yes to a six-week pilot in Biology and Algebra, with conditions C1 to C8. It is a made-up decision in a made-up story.

A real school might decide differently. What matters is that the decision rests on evidence, has clear conditions, and heard from many people.

Why this matters beyond Harbor Point

AI can affect society in good and bad ways. AI technologies are changing how people work, travel, communicate and care for each other.

End users use a system for a purpose. Affected people include everyone it touches, even people who never use it.

You are already both. That makes you someone who can ask the questions this course practiced.

All AI actors share the job of deciding whether AI is the right tool at all. Reviewers like you are part of that.

AI actor spotlight: every role
Design and development: the builder, who planned, built and tuned SH-1.
Deployment, operation and monitoring: Harbor Point staff and teachers, who would run the pilot and watch its outputs.
TEVV, human factors and impact assessment: the crew, with tests, a report form and the risk register.
Domain experts: the four teachers. Procurement: the district office. Governance and oversight: the panel.
Third parties, end users, affected people and outside groups: everyone else the review touched.
THE PANEL MEETING
  • Read the question.
  • Tap your answer.
What did the panel vote for?
What changed Comet's mind since week 1?
What changed Wren's mind from no-go?
You use technology and are touched by it. Which roles are you?

Course review

  1. An AI system makes outputs such as predictions, recommendations, decisions or content, with some autonomy, and it is socio-technical.
  2. Models learn patterns from training data. Generative models predict what comes next, which can produce confident wrong answers.
  3. Test on a realistic test set, count false positives and false negatives, and break results down by group.
  4. Privacy, security, information integrity, intellectual property, footprint and the value chain are all part of a review.
  5. Keep humans in charge with clear roles, and make a clear go or no-go decision with input from many people.
Course reviewTrue or false?
Real AI is a tool people build, and it can be wrong.?
A high score on a trivia test proves SH-1 works for Harbor Point.?
Breaking results down by class revealed the Spanish gap.?
Only people who write code have a role in AI.?
AI technologies are changing how people work, communicate and care for each other.?
WHY THIS EXERCISEThese are the ideas you can carry into any decision about AI.
THE SH-1 REVIEW, IN ORDER
  • ?We studied privacy, security, real and fake, footprint and the value chain.
  • ?We finished the card and register and recommended go, with conditions.
  • ?We tested SH-1 with TS-40 and CK-20 and broke the results down by class.
  • ?The proposal packet arrived, and we asked what kind of system SH-1 is.
  • ?We put humans in charge with a trust ladder and an oversight plan.
  • ?We trained and ran Tiny Text by hand to see how models learn and write.
WHY THIS EXERCISEEach step gave the next one its evidence.

Congratulations, reviewer. You finished the SH-1 Review. Tomorrow's Explorer Quest takes the recommendation home.

← Thursday