By Cheval John | Vallano Media
This article was created with the assistance of artificial intelligence.
The final version was reviewed, edited and fact-checked by the author

Graphics created with AI-assisted design tools.
Visual concepts, editorial direction, composition, and final creative decisions were developed by Vallano Media.

One of the easiest mistakes to make with artificial intelligence is also one of the most dangerous.

The answer looks finished.

The language sounds confident.

The explanation makes sense.

So you believe it.

That is exactly when a journalist needs to slow down.

AI can be useful for finding patterns, organizing information, generating questions, comparing claims and helping a journalist think through a story.

But none of those things make the AI-generated answer proof.

That distinction has become one of the most important rules in my own work:

AI output is not evidence

If an AI system gives me a fact, I still need to verify it.

If it gives me a quote, I need to find the original source.

If it gives me a statistic, I need to trace it back to the organization or dataset that produced it.

If it tells me that something happened, I need evidence that it actually happened.

The AI response may help me know where to look.

It may even point me directly toward legitimate evidence.

But the answer itself does not replace the proof.

Confidence Is Not Verification

Generative AI has a particular ability that makes this problem more difficult.

It can sound certain.

A wrong answer may not look wrong.

It may arrive in clean sentences with a logical explanation and enough detail to make the reader think the system must know what it is talking about.

That creates a dangerous shortcut.

The journalist stops asking:

“Is this true?”

And starts asking:

“Does this sound true?”

Those are not the same question.

Journalism cannot operate on plausibility alone.

A statement can be reasonable and still be wrong.

A date can look right and still be wrong.

A statistic can sound familiar and still be invented, outdated or taken out of context.

A quote can sound exactly like something a person would say and still never have been said.

That is why confidence cannot be treated as verification.

The Evidence Has to Exist Beyond the AI Answer

When AI gives me useful information, one of my next questions is usually:

Where is the evidence?

That may mean an official report, a government database, a court document, a transcript, a recording, a reputable news report or a historical archive.

The form will depend on the story.

What matters is that I can inspect the underlying evidence independently rather than treating the AI-generated answer itself as proof.

That distinction becomes even more important when the claim is central to the story.

The more consequential the claim, the more carefully I want to examine what supports it.

An AI system can point toward evidence.

It can summarize evidence.

It can help compare evidence.

But the evidence still has to withstand scrutiny on its own.

A Citation Is an Invitation to Verify

AI systems create another temptation.

They can provide citations.

A citation may look complete.

Author.

Title.

Publication.

Date.

Maybe even a link.

That still does not mean the work is done.

The source may not exist.

It may exist but not say what the AI claims it says.

The citation may point to something outdated.

Important context may have been omitted.

Details from several sources may have been mixed together.

That means I cannot verify a claim simply by seeing a citation attached to it.

I have to open the source.

Read it.

Confirm the relevant material.

Check the date.

Understand the context.

And decide whether the evidence actually supports the statement I want to make.

A citation is not verification.

It is an invitation to verify.

Verification Changes the Question

Early in my AI use, I was much more likely to ask:

“What is the answer?”

Now I am more likely to ask:

“What evidence supports this answer?”

That small change has made a significant difference in how I work.

The first question invites the system to produce information.

The second forces me to think about the information differently.

What would prove this?

Who would know?

Where would the original record exist?

Is there a primary source?

Does another independent source confirm it?

Is the information current?

Am I looking at the original claim or somebody repeating it?

Those questions move the process away from information generation and toward verification.

And that is where journalism has to live.

Primary Does Not Mean Infallible

When a primary source exists, I usually want to see it.

If a government agency publishes the data, I want the agency’s report.

If a university announces something, I want the university’s documentation.

If a sports organization changes a rule, I want the official rulebook or announcement.

If a company reports financial results, I want the filing or official release.

But there is an important distinction.

Primary does not mean infallible.

A company can emphasize information that benefits the company.

A government agency can provide an incomplete picture.

A university can frame an announcement in its own interest.

A court filing represents a party’s legal position, not necessarily an established fact.

Getting closer to the original record does not eliminate the need for judgment.

The source still has to be evaluated.

Secondary reporting matters too.

Good journalism can provide context, expertise, independent confirmation and scrutiny that the original source does not provide.

So my preference for primary evidence is not a rule that says primary sources are always better or always correct.

It means I want to understand where the claim originated before deciding what it proves.

Two Sources Do Not Automatically Mean Two Confirmations

Another verification trap appears when the same claim shows up in multiple places.

It is tempting to think:

Two sources say it, so it must be confirmed.

Not necessarily.

Both sources may be repeating the same original report.

One may have copied the other.

Both may rely on the same press release.

Both may be citing the same anonymous source.

AI can make this especially tricky because it may summarize several webpages that appear to agree when all of them ultimately trace back to one original claim.

So verification is not simply about counting links.

It is about understanding provenance.

Where did the information originate?

Are the confirmations actually independent?

What evidence does each source possess?

Even two genuinely independent sources can be wrong.

Independence increases confidence.

It does not eliminate the need to evaluate the quality of the evidence itself.

Verification Is More Than Fact-Checking

Verification is often described as fact-checking.

That is part of it.

But verification is broader.

A sentence can contain technically correct facts and still create a misleading impression.

A statistic may be accurate but missing context.

A quote may be authentic but selectively presented.

An AI-generated summary may include the facts while flattening uncertainty or leaving out an important qualification.

So verification also means asking:

What is missing?

What would change the interpretation?

What assumptions are hidden inside this claim?

Does the evidence support the conclusion being drawn from it?

That is where verification overlaps with editorial judgment.

Sometimes the Answer Is: We Do Not Know Yet

Verification does not always produce certainty.

Sometimes the records are incomplete.

Sometimes sources disagree.

Sometimes a developing event is changing faster than the available evidence can keep up.

Sometimes the most accurate conclusion is:

We do not know yet.

That is not a failure of journalism.

Pretending to know would be the failure.

This is especially important during breaking news.

Waiting until every uncertainty disappears is not always possible or desirable.

The public may have a legitimate need for information before the full picture is known.

The responsibility then is different.

Publish what the evidence supports.

Clearly distinguish confirmed information from what remains uncertain.

Attribute claims.

Avoid presenting speculation as fact.

Update the reporting when stronger evidence becomes available.

Verification is not always a switch between “publish” and “do not publish.”

Sometimes it determines what can responsibly be published right now.

AI Can Help With Verification — Carefully

There is an irony in all of this.

The same technology that creates new verification problems can also help with verification.

AI can help surface claims that may need checking.

It can compare documents, identify apparent inconsistencies, generate questions and challenge an assumption.

Those uses can be valuable.

But there are two boundaries I try to maintain.

First, AI does not decide which claims deserve the deepest scrutiny.

That remains an editorial judgment.

A journalist has to decide which claims are central, disputed, risky or consequential enough to require more work.

Second, AI cannot certify its own answer.

If an AI system produces a claim, asking that same system whether the claim is correct is not independent verification.

AI can assist the verification process.

It cannot become the final authority within that process.

The Verification Record Matters

One of the principles I keep returning to is that the evidence trail matters more than the appearance of certainty.

Someone can speculate that an article was produced with AI.

Someone can run the article through an AI detector.

Even if someone could perfectly determine whether AI was involved, that still would not establish whether the journalism itself was accurate.

Those are different questions.

Accuracy depends on evidence.

What sources were used?

What claims were checked?

What evidence supports the central statements?

What uncertainty remained?

What was changed or removed during the editorial process?

Those questions tell me much more about the quality of the journalism than simply asking whether AI touched the work.

The important question is not:

“Was AI involved?”

The better question is:

“Can the journalism be verified?”

A Real Workflow Needs a Verification Stage

This is where verification connects directly to the workflow I described in Chapter 2.

A workflow is not complete because it produces a draft.

A responsible workflow needs a verification stage.

In my own work, that often means stopping after the draft and examining the factual claims.

Which statements came from firsthand reporting?

Which came from primary documents?

Which came from secondary reporting?

Which originated as AI suggestions?

Which require another source?

Which are interpretations rather than established facts?

Which statements sound stronger than the evidence actually allows?

That pause matters.

It separates production from publication.

AI can make it easier to generate material quickly.

Verification is where I decide whether that material deserves to become journalism.

When Verification Gives the Time Back

There is something else worth acknowledging.

Verification takes time.

Sometimes AI saves time on one part of the process and verification gives some or all of that time right back.

Sometimes verification takes longer than the drafting.

That is not necessarily a failure of the workflow.

It may be the workflow doing exactly what it is supposed to do.

If a claim takes 20 minutes to verify, those 20 minutes are part of producing trustworthy work.

This is why I do not measure AI productivity only by how quickly a draft appears.

The better question is whether AI helps me move through the entire process without lowering the standard.

If the draft arrives faster but verification becomes weaker, I have gained very little.

If AI helps me spend less time on mechanical work and more time examining the evidence, that is a much more meaningful improvement.

The Journalist Has to Be Willing to Let Go

Sometimes verification produces an answer nobody wants after spending time on a story:

The evidence is not strong enough.

Maybe a sentence has to go.

Maybe an entire section has to go.

Maybe the central claim has to be rewritten.

Maybe the story has to wait.

And sometimes, after all that work, the story should not be published at all.

That can be difficult.

The draft exists.

Time has already been invested.

The headline may be good.

A graphic may even be finished.

None of those things turn weak evidence into strong evidence.

At the same time, uncertainty does not always require abandoning the entire story.

Sometimes the responsible decision is to publish only the portion that can be supported and clearly explain what remains unknown.

The principle is the same either way:

The evidence determines what survives.

Not the amount of work already invested.

Not how convincing the draft sounds.

And not how badly I want the story to be true.

Trust Is Built Before Publication

Readers usually see the finished article.

They do not see the searches.

The discarded sources.

The rewritten paragraphs.

The claims that were removed.

The moments when the journalist stopped and said:

I cannot prove this.

Or:

We do not know this yet.

Those invisible decisions are part of what makes the final product trustworthy.

AI does not change that.

If anything, those decisions become more important because plausible information has become easier to produce.

The harder task is deciding what deserves to survive.

That is why verification cannot be treated as an optional final check.

It has to be built into the process.

Evidence Before Confidence

AI can be fast.

It can be useful.

It can be impressive.

It can also be wrong.

The journalist’s job is not to be impressed by the answer.

The journalist’s job is to determine what the evidence supports.

That means asking where the information came from.

Opening the source.

Checking the context.

Looking for independent confirmation when appropriate.

Understanding uncertainty.

And being willing to reject or qualify a claim when the evidence does not support certainty.

AI can help generate and challenge information.

But journalism begins when the information survives verification.

That is the line I keep returning to:

AI output is not evidence.

The AI answer may point toward the evidence.

The evidence still has to speak for itself.

Graphics created with AI-assisted design tools.
Visual concepts, editorial direction, composition, and final creative decisions were developed by Vallano Media.