← Back to course
AI and You 9-12 / Week 10 / Thursday
4/6
Week 10 Β· Footprint and Supply Chain

Thursday

The supply chain
// What SH-1 depends on, and who can use it
⏱ about 20 min

Thursday: The Supply Chain

Comet pins the SH-1 packet to the corkboard. "The builder made SH-1," she says, "so the builder can answer every question about it."

Wren points to section P2. "What does the evidence say? SH-1 is built on a large pre-trained model from another company. The builder did not make that part."

"Oh," Comet says slowly. "So SH-1 has parts from people we have never met."

Teacher Mara joins them. "And when SH-1 struggled with Spanish, whose part caused it?"

Nova draws a row of linked boxes on the wall, each one blank. "Would you like a hint?" she asks. "List every part SH-1 depends on, and who made each one."

Comet hands you a marker. "Reviewer, fill in the chain."

A value chain

Generative AI is built from many outside parts. They include datasets from other sources, pre-trained models and software libraries.

All the parts and makers a system depends on make up its value chain.

Parts that were badly obtained or never checked make a system less transparent and accountable.

The training data may also be too large for people to check.

Part of SH-1 (made up)Who supplies itWhat the crew knowsWhat the crew does not know
Base modelThe base model maker, a third partyIt is a large pre-trained language modelWhat it was trained on
Study material for tuningThe builderThe packet calls it "study material"Which material, in which languages
Software librariesNot listedNothingWhether any are used, and who made them
Class notesHarbor Point teachersExactly which pagesNothing important
SH-1'S VALUE CHAIN, FROM FIRST PART TO LAST USER
  • ?The builder tunes the base model on study material to make SH-1.
  • ?The district office approves getting SH-1 for the school.
  • ?Students and teachers use SH-1.
  • ?The base model maker trains a large base model.
  • ?Harbor Point runs SH-1 with its own class notes.
WHY THIS EXERCISESeeing the whole chain shows how many hands touch SH-1 before a student does.

Third parties and bottlenecks

Third parties are outside providers of data, models or systems. The base model maker is a third party for Harbor Point.

What a third party supplies can be complex or hard to see into. Its idea of acceptable risk may not match the school's.

When a system uses many outside parts, it can be hard to tell which part caused a problem.

Problems in big shared models can flow into every system built on them, like a bottleneck.

TRACE THE PROBLEM
  • Read the question.
  • Tap your answer.
SH-1 got 4 of 10 Spanish questions right. Which part caused it?
If the base model has a problem, which systems could it reach?
Who is a third party for Harbor Point?
Why might the base model maker's idea of acceptable risk differ from the school's?

Rating R9

The crew looks at the R9 row: value chain and component integration. Its SH-1 example is "base model and its training data unknown."

They rate likelihood High. Right now, nobody at Harbor Point can see into the base model or its data.

They rate size of harm Medium. A hidden problem could reach students' studying, but SH-1 is a study helper, not a grader.

These ratings are the crew's judgment in the story, not facts.

RowRiskSH-1 exampleLikelihoodSize of harm
R9Value chain and component integrationBase model and its training data unknownHighMedium
StatementTrue or false?
Generative AI value chains can include datasets, pre-trained models and software libraries.?
The builder made every part of SH-1 itself.?
With many outside parts, it can be hard to tell which part caused a problem.?
Training data may be too large for people to check.?
A problem in a big shared model stays inside one system.?
WHY THIS EXERCISEA reviewer cannot judge a system without knowing what it is made of.
An outside provider of data, models or systems is a ____.
All the parts and makers a system depends on make up its value ____.

Sharp tracing, reviewer. Tomorrow is Impact Friday: who gets to use SH-1 at all?

← Wednesday