Generative AI can confidently state things that are false, which NIST calls confabulation. It is a natural result of statistical prediction. People can also trust automated systems too much, so good users check important answers with trusted sources.