How to Check the Citations an AI Gives You
One of the most dangerous things a large language model does is produce citations that look completely real and are entirely invented. The author names sound plausible, the journal title fits the topic, the year is reasonable, and the whole thing is formatted correctly. None of that means the source exists. Treating AI-supplied references as trustworthy is how fabricated citations end up in real essays and reports, and it is a mistake that can sink your credibility instantly. This guide walks through how to check every one.
Why models fabricate references
A language model does not have a card catalog it looks things up in. It predicts text that is statistically likely given your prompt. A citation is just a very patterned piece of text, so the model is extremely good at generating something that has the shape of a citation without any guarantee that it points to a real document. It may blend two real papers into one, attach a real author to a title they never wrote, or invent a plausible page range and DOI out of thin air. These are not rare glitches; they are a predictable consequence of how the technology works. Assume every reference is guilty until proven innocent.
Verify the source actually exists
Start with existence before you worry about accuracy. Work through each reference in order:
- Search the exact title in quotation marks in a scholarly database or a general search engine. A real paper almost always surfaces immediately.
- Resolve the DOI if one was given. A valid DOI links to a real landing page; a fabricated one will fail to resolve or lead somewhere unrelated.
- Look up the author and confirm they work in this field and have published on this topic. A mismatch is a red flag.
- Check the venue — confirm the journal or publisher is real and that a volume and issue for that year actually exist.
If you cannot find the source through any of these routes, do not use it. A citation you cannot locate is not a citation; it is a liability.
Verify the source says what the AI claims
Existence is only half the job. A real paper can still be misrepresented. The model may cite a genuine study but summarize a conclusion it never reached, or invert a finding, or borrow a number from a different table. Once you have the actual document open, read the relevant section yourself and confirm three things: that the claim is present, that it means what the AI said it means, and that any figure or quote is reproduced exactly. Pay special attention to quoted material and page numbers, which models fabricate readily. If you cannot find the sentence you are supposedly citing, the citation does not support your point, no matter how real the paper is.
Build a habit that scales
Verification feels tedious the first few times and then becomes fast. A few habits make it sustainable:
- Never let an unverified reference sit in your document, even temporarily. Mark it clearly, for example with a bracketed note, so it cannot slip through.
- Log the source the instant you confirm it — capture the DOI, the access date, and the exact page — so you never have to re-find it.
- Prefer sources you can read in full over anything you can only see in a snippet.
- When the AI gives you a claim without a source, treat that as a research to-do, not as evidence.
What to do when a citation fails
When a reference turns out to be fabricated, resist the temptation to ask the model to “fix” it, because it will often just invent a fresh fake. Instead, take the underlying claim and go find real support for it yourself, using a library database, a reference manager, or the bibliography of a paper you already trust. If no real source supports the claim, then the claim itself may be wrong, and you have just been saved from publishing an error.
The rule is short and worth memorizing: a citation from an AI is a lead to investigate, never a source to cite. Do the checking, keep the receipts, and your bibliography will hold up to any scrutiny it faces.