What It Means
When an AI model generates information that is factually incorrect, fabricated, or nonsensical while presenting it with the same confidence as accurate information. AI models do not "know" facts - they predict likely word sequences, which can produce convincing-sounding fiction.
Why writers should care: Ironically, hallucinations are one of the clearest signs that AI wrote something. If your accused text contains verified facts, that's evidence in your favor.
In Context
AI hallucination is not a bug being fixed - it is a fundamental property of how language models work. Because they predict likely next words rather than retrieving verified facts, they can generate confident, well-structured prose about events that never happened, quotes that were never said, and studies that were never published. For writers accused of using AI, the presence of verified facts and specific, accurate details in their work can actually serve as evidence of human authorship.
Related Terms
- AI Detection - Software that attempts to determine whether a piece of text was written by a human or generated by an artificial intelligence.
- Algorithmic Bias - Systematic errors in AI systems that produce unfair outcomes for certain groups.
- Burstiness - A measure of how much variation exists in the complexity and length of sentences within a piece of writing.
- C2PA - The Coalition for Content Provenance and Authenticity - an open standard for certifying the origin and history of digital content.
- Content Provenance - The documented history of a piece of content from its creation through every edit, save, and publication.