Privacy is the norms and practices that protect people's autonomy, identity and dignity, and anonymity, confidentiality and control should guide AI design. Generative AI can leak or misuse personal information, and using personal data for training puts pressure on privacy principles such as transparency, consent and purpose. Data can be collected and combined across huge numbers of people without them noticing, and AI can infer who someone is or private facts about them. De-identification and aggregation help, but in some cases privacy methods can lower accuracy. Sometimes one person's privacy is at odds with a community's safety or wellbeing.