← Back to course
Applied AI / Week 05 / Wednesday
3/6
Week 05 Β· Fair for Everyone

Wednesday

Spot the problem: a biased draft
// Who is missing, and who is misjudged?
⏱ about 15 min

Wednesday: Spot the Problem

Rosa wants to plan her spring email to customers. She does not paste her customer list, because she learned that lesson in week 3.

Instead she asks a chatbot a general question: who usually buys flowers, and what should her email say?

The answer comes back sure of itself. As she reads, a few lines make her frown. Some of her best customers do not fit it at all.

How bias shows up in writing

Bias in a written output is not always rude or obvious. Often it is a quiet guess about who people are.

NIST warns that generative AI can amplify social biases. In writing, that can look like a stereotype stated as a fact.

A stereotype is a fixed, oversimplified idea about a whole group of people.

Two questions for any output
Who is missing? Which people does this leave out or ignore?
Who is misjudged? Which people does it describe unfairly or get wrong?
These questions are a method this course suggests, not a test that catches everything.

Your turn: read Rosa's output

Read this example. It was written for this lesson. It contains four lines with bias to find.

Example output (written for this lesson)
Request: Describe who usually buys flowers from a small shop, and suggest a spring email.
Output: Most flower buyers are young women shopping for themselves or for a date.
Men rarely buy flowers, so there is no need to write for them.
Skip older customers. They do not read email.
Write only in English. Customers who speak other languages will not matter for sales.
Suggested email: Spring is here! Brighten your home with fresh tulips this week.
Line in the outputIs it free of bias?
"Most flower buyers are young women shopping for a date."?
"Men rarely buy flowers, so there is no need to write for them."?
"Skip older customers. They do not read email."?
"Write only in English."?
"Brighten your home with fresh tulips this week."?
WHY THIS EXERCISEEach biased line is a guess about a group, stated as if it were true.
MISSING OR MISJUDGED?
  • Read the question.
  • Tap your answer.
"Skip older customers. They do not read email." What does this line do?
"Write only in English" leaves out which customers?
Where does a line like "men rarely buy flowers" come from?
What should Rosa do with the four biased lines?
Name one group of customers this output would leave out.
WHY THIS EXERCISENaming who is missing is the first step to fixing the plan.

Notice that the output sounds confident. In week 2 you saw that confident and correct are not the same.

Rosa's fix is simple. She writes one email for all her customers, and she checks it with what she knows.

Sources: NIST AI 600-1, Generative AI Profile (2024)

Tomorrow: fairness in your own track.

← Tuesday