← Back to course
Applied AI / Week 06 / Wednesday
3/6
Week 06 Β· Fakes and Scams

Wednesday

Spot the problem: the polished email
// Clean text, cloned voices and a family code word
⏱ about 15 min

Wednesday: Spot the Problem

Rosa opens an email that seems to come from her flower supplier. It is warm and clear, with no typos at all.

It says the supplier has a new bank account and that today's order will be held unless she pays now.

Rosa almost reaches for her card. Then she remembers this week's lesson and reads it again, slowly.

Read like a detective

Read the example below. It was written for this lesson. It contains several warning signs to find.

Remember: the writing being clean tells you nothing. Look at what the message asks you to do.

Example output (written for this lesson)
Subject: Urgent: update to our payment details
Hi Rosa, thank you for being such a loyal customer!
Our bank has changed, so please send today's payment to the new account below.
Your spring order will be held unless payment arrives within two hours.
Our phone line is down this week, so please reply only to this email.
If a bank transfer is hard, gift cards are fine too.
Please keep this between us while we update our records.
Warm regards, the Accounts Team
Line in the emailIs it a warning sign?
Please send today's payment to a new account.?
The order will be held unless she pays within two hours.?
Reply only to this email, because the phone is down.?
Gift cards are fine too.?
Thank you for being a loyal customer.?
WHY THIS EXERCISEA kind greeting is normal. Pressure, new payment details and blocked checks are not.
WHY EACH SIGN MATTERS
  • Read the question.
  • Tap your answer.
Why is "reply only to this email" a problem?
What does the FBI say about gift cards?
What should Rosa do next?

Can a chatbot tell her if it is real?

Rosa wonders whether to paste the email into a chatbot and ask if it is a scam.

NIST notes that generated content may not say when it is unsure. NIST also notes that AI tools can be attacked.

Two named attacks are prompt injection and data poisoning. Both tamper with how a tool behaves.

So a tool's answer is not proof either way. The call back to a known number is still the real check.

Name one warning sign you found in the email.
WHY THIS EXERCISENaming the sign out loud helps you pause before you act.
The email asks Rosa to pay into a ____ account.
It gives her only two ____ to pay.
It asks her to keep it ____ us.

Sources: FBI IC3, Criminals Use Generative AI to Facilitate Financial Fraud (2024) Β· NIST AI 600-1, Generative AI Profile (2024)

Tomorrow: what this looks like at home, at school and at work.

← Tuesday