← Back to course
AI and You 9-12 / Week 04 / Wednesday
3/6
Week 04 · How Generative Models Write

Wednesday

Explorer Lab: Roll ten sentences
// One word at a time, smooth but not always true
⏱ about 20 min

Wednesday: Explorer Lab: Roll Ten Sentences

Comet sets a die on the table like a trophy. "Ten sentences each. Then we compare."

Wren writes a claim at the top of his graph paper: "Tiny Text only repeats its training sentences."

"Do you believe that?" Comet asks.

"Not yet," Wren says. "It is a hypothesis. The rolls will test it."

Nova hovers between them and projects the die rules on the wall. "Would you like a hint?" she asks. "Keep a column for which box each sentence lands in."

Comet rolls first. Wren records every number she gets.

Later they compare their lists with the crew's first run, and Comet laughs. "Half of mine are new!"

Your mission

You will generate 10 sentences with the die rules, sort each one into a box, and test Wren's hypothesis.

  • A die, or six paper slips numbered 1 to 6 in a cup (draw one, then put it back)
  • Paper and a pencil
  • The six training cards and the die rules below
CardTraining sentence
T1the library opens at eight
T2the library has quiet rooms
T3the lab opens at nine
T4the lab has new desks
T5the library opens at eight
T6the gym opens at seven
After this wordRoll the dieNext word
the1, 2 or 3library
the4 or 5lab
the6gym
library1, 2, 3 or 4opens
library5 or 6has
lab1, 2 or 3opens
lab4, 5 or 6has
gymno rollopens
opensno rollat
at1 or 2eight
at3nine
at4seven
at5 or 6roll again
has1, 2 or 3quiet (then rooms)
has4, 5 or 6new (then desks)
PREDICT FIRST
  • Read the question.
  • Tap your answer.
Wren's hypothesis: "Tiny Text only repeats its training sentences." What do you predict?
  1. Write "the" at the start of a new line, numbered 1.
  2. Roll and look up the next word in the die rules. Write it down.
  3. After gym and opens, write the next word without rolling.
  4. After "at", roll again on a 5 or a 6.
  5. Stop at eight, nine, seven, rooms or desks.
  6. Repeat until you have 10 sentences.
  7. Check each sentence against the cards. Mark it in the data, contradicts or unsupported.
  8. Count how many sentences landed in each box.

Compare with the crew's run

This is the crew's first run of 10 sentences. It is a made-up example from the SH-1 review story.

NumberThe crew's sentence
1the library opens at eight
2the lab has new desks
3the library opens at nine
4the gym opens at eight
5the library has quiet rooms
6the library opens at eight
7the lab opens at seven
8the library has new desks
9the gym opens at seven
10the library opens at seven
SORT THE CREW'S RUN
  • Read the question.
  • Tap your answer.
How many of the crew's 10 sentences match the data?
How many contradict the data?
Which sentence is unsupported?
What part of the crew's 10 sentences were new, not on a card?
Lab findingTrue or false?
Wren's hypothesis, "Tiny Text only repeats its training sentences", is supported.?
Every one of the crew's sentences reads smoothly.?
Something in each sentence marks which ones are wrong.?
Two runs of Tiny Text can give different sentences.?
WHY THIS EXERCISETesting a hypothesis with a model is how scientists find out what the model really does.
On paper, make a bar graph with three bars for your own run: in the data, contradicts and unsupported. Then add the crew's three bars beside yours.

Great lab work, reviewer. Tomorrow you will see why a confident answer is not the same as a correct one.

← Tuesday