← Back to course
Applied AI / Week 02 / Thursday
4/6
Week 02 Β· Why It Gets Things Wrong

Thursday

Track day: wrong in your world
// Confident answers, made-up sources and our habit of trusting machines
⏱ about 15 min

Thursday: Wrong in Your World

Ben asks a chatbot for four picture books about friendship for his fourth graders. He searches the school library catalog for each one.

Rosa asks a chatbot to summarize her shop's refund policy for her website.

Maya plans how to talk with her kids about answers that sound sure but are wrong.

Each of them is about to meet the same problem in a different place.

Read your own track first. Each one uses this week's ideas: confabulation, made-up sources and automation bias.

For parents

A homework helper can give a confident wrong answer, and even a source that cannot be found.

You do not need to know the subject to help. You can ask your child to show where each fact came from.

One plain way to say it: "It sounds sure, but sounding sure is not the same as being right."

Whether your child uses any AI tool is your decision. If they do, sit with them and check answers together.

For teachers

Here is Ben's reading list. The titles and authors were made up for this lesson, and so are the catalog results.

Example output (written for this lesson)
Request: List four picture books about friendship for fourth graders, with authors.
Output: 1. The Bridge Between Us, by Ana Lark.
2. Two Kites, One Wind, by Sam Okafor.
3. The Lunch Table Map, by Priya Dale.
4. Harbor Light Friends, by Joel Wren, winner of a national children's book prize.
BookBen's catalog search
The Bridge Between UsFound, with this author
Two Kites, One WindFound, with this author
The Lunch Table MapFound, with this author
Harbor Light FriendsNo record anywhere Ben looks

A list can look complete and still include a book that may not exist. The prize line is another unchecked claim.

Check every title before it reaches families or students.

For small-business owners

Here is Rosa's real policy, and the summary a chatbot gave her. Both were written for this lesson.

Rosa's policyThe chatbot's summary
If flowers arrive damaged, contact us within 24 hours with a photo.Damaged flowers are replaced if reported within 24 hours. Photos are optional.
We will replace the order.Customers can get a full refund within 7 days for any reason.
We do not give cash refunds.Refunds go back to the original card.

The summary invents a refund rule Rosa never wrote. If she posts it, customers will expect it.

Always check a summary against the document it came from, line by line.

YOUR TRACK, YOUR CHECK
  • Read the question.
  • Tap your answer.
Ben cannot find "Harbor Light Friends" anywhere. What should he do?
Which line in Rosa's summary was invented?
A child says, "But it sounded so sure." What is a good reply?
Rosa's summary lineMatches her policy?
Damaged flowers are replaced if reported within 24 hours.?
Photos are optional.?
Customers can get a full refund within 7 days.?
Refunds go back to the original card.?
WHY THIS EXERCISEA summary can add, drop or flip a rule, so you compare it with the source.
Your track: name one document you might ask an AI tool to summarize or list for you.
WHY THIS EXERCISEThe documents you rely on most are the ones to check most carefully.

Sources: NIST AI 600-1, Generative AI Profile (2024)

Tomorrow: a short review of the week.

← Wednesday