Teacher Lin stops by the review table with a stack of Biology quizzes. "If SH-1 writes quizzes, I still have to teach with them," she says.
Comet looks surprised. "But you would not be using SH-1. The students would."
Wren taps the packet. "What does the evidence say? The log keeps names. Families might care, even if they never see SH-1."
Nova projects a ring of circles on the wall, with SH-1 in the middle. "Would you like a hint?" she asks. "Draw everyone SH-1 could touch, not just the people who type."
Teacher Lin smiles at you. "Reviewer, who belongs in those circles?"
AI systems are socio-technical. That means people and society shape them, not just code.
Their risks and benefits come from the technology together with how it is used, who runs it and where.
The same SH-1 could help in one class and cause trouble in another, depending on how teachers and students use it.
AI can affect society in good and bad ways. AI technologies are changing how people work, travel, communicate and care for each other.
End users use a system for a purpose. They range from experts to people using it for the first time.
Affected people include everyone the system or its decisions touch, even people who never use it.
The general public feels AI's good and bad effects most directly.
| Made-up person or group | Uses SH-1? | How SH-1 could touch them |
|---|---|---|
| A student who asks SH-1 questions | Yes, an end user | Gets fast answers, which might be wrong |
| A student who studies only from books | No | Takes quizzes that SH-1 wrote |
| Teacher Lin | Sometimes | Teaches with SH-1 quizzes and fixes its mistakes |
| Families | No | Their student's name and study times would sit in the log |
The crew is building its own one-page form about SH-1, which it calls a model card. It is the crew's form, not an official one.
Each week adds a piece. This week the crew fills in the name, the purpose and the out-of-scope uses.
Out-of-scope uses are jobs SH-1 should not do, even if someone asks.
| Model card field | What the crew writes |
|---|---|
| Name | SH-1 (Study Helper, version 1), offered by an outside builder |
| Purpose (from P1) | Answers study questions, writes practice quizzes from class notes, checks students' answers |
| Out-of-scope uses | Not for grading. Not a replacement for teachers. |
| Week review | True or false? |
|---|---|
| SH-1 fits the definition of an AI system. | ? |
| A system with a sensor is always AI. | ? |
| Training data can go stale. | ? |
| Only people who use an AI system are affected by it. | ? |
| "Not for grading" is one of SH-1's out-of-scope uses on the crew's card. | ? |
What a first week, reviewer. Tomorrow's Explorer Quest takes the rules-or-AI question home.