How to Check an AI Answer Before You Use It

How to Check an AI Answer Before You Use It

An AI answer can be clear, helpful, and wrong at the same time. It might mix a correct explanation with an outdated price, misread a document, invent a quotation, or make a simple arithmetic mistake. A link beside the answer does not prove that the linked page says what the answer claims.

The fix is a short habit: find the claims, find the source, compare the details, check the numbers, and decide what remains uncertain. You do not need to verify every sentence equally. Spend the most effort on claims that are current, surprising, or important to your decision.

A worked example: the convincing wrong answer

Imagine that a community center has posted this fictional workshop notice. It is the complete source for our exercise:

Saturday drawing workshop

• Saturday, November 7, 2026, 2:00–3:30 p.m.
• Admission: $12 per adult; $6 per student.
• Advance registration is required.
• The notice does not state when the doors open.

You ask an AI assistant: “When is the workshop, and how much will two adults and one student pay?” It answers:

The workshop starts at 3:00 p.m. Doors open at 1:30 p.m. Two adults and one student pay $36. Registration is required.

The answer sounds complete, but only its final sentence is supported. Here is how to catch the rest.

1. Turn the answer into checkable claims

Break a fluent paragraph into individual statements. For the example, the claims are:

Do this especially for names, dates, prices, quotations, statistics, rules, and instructions. Words such as “always,” “never,” and “guaranteed” deserve a second look because a single exception can change the meaning.

2. Open the source yourself

Ask the assistant for sources if it has not supplied them, then open each relevant link or original document. Check who published it, when it was updated, and whether it actually supports the specific claim. For an event, the organizer's current notice is usually more useful than an old social post. For a software feature, inspect the current official documentation. For a study, read the study's methods and results, not just a summary of it.

A real link can still lead to a page about a different event or to a page that contradicts the answer. A citation is a route to evidence, not evidence that the answer has been checked. If the source is inaccessible, say that the claim is unverified rather than filling the gap from the assistant's confidence.

In our example, the notice says 2:00 p.m. It gives no door-opening time. The assistant's 1:30 p.m. claim has no support, even though it sounds plausible.

3. Compare the exact detail, including omissions

Read the relevant sentence or table in the source. Match the date, units, location, eligibility conditions, and wording. If an answer uses quotation marks, find those exact words in the original. A paraphrase may convey the meaning, but it should not masquerade as a direct quote.

Check what the answer leaves out, too. The workshop requires advance registration. An answer about attending should preserve that condition. If two sources disagree, note the disagreement and look for the most authoritative, recent source. Do not ask the AI to settle the dispute by repeating its first answer.

4. Redo the calculation

Write down the inputs and units, then calculate independently:

2 adults × $12 = $24
1 student × $6 = $6
Total = $24 + $6 = $30

The AI's $36 total is wrong. Showing the steps makes the error easy to locate. For a spreadsheet or report, check the original cells, time period, and denominator as well as the arithmetic. A correct calculation with the wrong inputs is still a wrong answer.

5. State what is confirmed and what is unknown

A corrected answer to the example would be:

The fictional workshop is Saturday, November 7, 2026, from 2:00 to 3:30 p.m. Two adults and one student would pay $30. Advance registration is required. The notice does not give a door-opening time, so check with the organizer if you need that detail.

That last sentence matters. “I could not verify it” is more useful than an invented detail. For a live event, check the organizer's notice again before traveling; details can change after an article is written.

Match the check to the stakes

For a casual idea, a quick source check may be enough. For a purchase, travel plan, school assignment, or public post, check the facts you will repeat or act on. For medical, legal, financial, safety, or workplace decisions, use an appropriate qualified professional, official source, or required review process. The cost of being wrong determines how much checking you need.

Here is a prompt that can help organize your review:

List the factual claims in your answer. For each one, show the exact supporting passage and link to its original source. Separate calculations from source facts. Mark anything you could not verify, and do not invent missing details.

Then perform the important checks yourself. The assistant can make mistakes in its second answer too. The ChatGPT beginner's guide explains how to request sources; What Is an LLM? explains the kind of system behind the response.

A one-minute checklist

Before you use an AI answer, ask:

1. Which claims would matter if they were wrong?
2. Can I open a current, relevant source for each one?
3. Does the source say exactly what the answer says?
4. Can I reproduce the numbers from the original inputs?
5. What remains unknown, disputed, or subject to change?

An AI answer is a starting point. A checked answer is something you can explain and trace back to evidence.

Further reading

• NIST's Generative AI Profile describes confident false content and misleading citations as risks of generative AI.
• OpenAI: Does ChatGPT tell the truth? advises checking important information, quotes, data, and references against reliable sources.