How AI goes wrong · Lesson 1 of 3
Sure but wrong
A model picks fluent next words even when a fact or citation does not exist, so confidence in tone never proves a claim.
Unguarded prompt
Summarise our parental leave carry-over rule and cite the section number.
Unguarded reply
Under Section 4.3 of the handbook, staff may carry up to 12 unused parental leave days into the next leave year with line-manager sign-off.
Without the pasted policy and the quote rule, the model filled the gap with a plausible Section 4.3 that does not exist.
Closing Daily five call