Tag Archive | AI Transparency

The Human in the Loop

By Cheval John | Vallano Media
This article was created with the assistance of artificial intelligence.
The final version was reviewed, edited and fact-checked by the author


Graphics created with AI-assisted design tools.
Visual concepts, editorial direction, composition, and final creative decisions were developed by Vallano Media.

“Keep a human in the loop.”

It sounds simple.

It also sounds reassuring.

Put a person somewhere in the process, and the risks of artificial intelligence are supposedly under control.

But that phrase can hide a much harder question:

“What is the human actually doing?”

If the person is simply approving whatever the AI produces, the human is technically in the loop.

That does not mean the human is exercising judgment.

If the editor is rushed, the reporter is overconfident, or the organization has built a workflow that encourages people to trust the technology without questioning it, human oversight can become little more than a formality.

That is not enough.

A meaningful human role requires more than presence.

It requires authority.

It requires understanding.

It requires skepticism.

And sometimes, it requires saying no.

Being Present Is Not the Same as Being in Control

AI-assisted workflows often include a human checkpoint.

Draft.

Review.

Approve.

Publish.

On paper, that looks responsible.

But a checkpoint only matters if the person at that checkpoint understands what they are reviewing and has the authority to stop the process.

If an AI-generated summary is wrong and the journalist never checks the source, the human review did not accomplish much.

If an editor sees a polished draft and assumes someone else already verified it, the human review did not accomplish much.

If a newsroom requires approval but creates deadlines so tight that nobody has time to challenge the output, the system may have a human in the loop without meaningful human control.

That distinction matters.

The goal is not simply to insert a person between AI and publication.

The goal is to preserve human judgment at the points where judgment matters most.

And even then, human oversight is not a guarantee of correctness.

It is a mechanism for accountability, challenge and intervention.

What the Human Still Has to Decide

Artificial intelligence can assist with many parts of journalism.

It can help organize research.

It can summarize documents.

It can compare information.

It can suggest questions.

It can challenge an argument.

It can help edit a draft.

But journalism still contains decisions that are difficult to reduce to a checklist.

Is this source credible?

Is this statistic meaningful without additional context?

Is the headline accurate or merely dramatic?

Is there enough evidence to publish?

Would publication cause harm that outweighs its value?

Those decisions require editorial judgment.

AI may contribute information to the decision.

But for consequential editorial decisions, accountable human judgment still has to remain decisive.

The Human Must Understand the Task

Human oversight becomes weak when the person supervising the AI does not understand the work being delegated.

That does not mean a journalist has to understand every technical detail of the AI system.

I do not need to know how every line of code inside a model works before I can use it responsibly.

But I do need to understand the journalistic task.

I need to understand what a good result looks like.

I need to understand the limitations of the tool.

And I need to understand the standard the output has to meet.

If I ask AI to help fact-check a story but I do not understand verification, I may accept a weak check as a strong one.

If I ask AI to help write a headline but I do not understand how headlines can distort a story, I may accept something misleading because it sounds good.

If I use AI to summarize a report but never read the underlying material, I may not notice what the summary left out.

That leads to a principle I keep returning to:

“You cannot responsibly supervise work you do not understand well enough to judge.”

Delegation does not require knowing everything.

It does require knowing enough to recognize when the result is not good enough.

The Danger of the Rubber Stamp

One way human oversight can fail is through overreliance on automated output.

The system produces an answer.

The answer looks polished.

The human assumes the machine probably got it right.

Instead of reviewing the work, the person confirms it.

That is a very different behavior.

A rubber stamp may technically satisfy a policy requiring human approval.

It does not satisfy the deeper purpose of human oversight.

The human has to be willing to interrupt the process.

That may mean asking:

Where did this come from?

What did the AI leave out?

Does the source actually support this?

What assumption is hidden here?

Why is this being presented as certain?

Would I publish this if AI had not suggested it?

Those questions turn oversight into active supervision.

And the phrase “human reviewed” can be just as misleading as “AI-generated” if nobody explains what the review actually involved.

Not Every Task Needs the Same Oversight

There is another important distinction.

Human oversight should be proportional to risk.

A low-risk formatting task does not require the same level of scrutiny as a factual claim.

Correcting capitalization is not the same as evaluating an accusation.

Reformatting notes is not the same as verifying breaking news.

Suggesting alternative headlines is not the same as deciding whether an investigative conclusion is supported.

If every AI-assisted task requires the same level of manual review, the workflow can become so cumbersome that the technology provides little benefit.

The goal is not maximum friction.

The goal is appropriate friction.

The higher the stakes, the stronger the oversight should be.

That requires the journalist or organization to understand where the real risks are.

Sometimes the Human Has to Slow the System Down

Artificial intelligence is often sold through speed.

Faster research.

Faster drafting.

Faster editing.

Faster production.

That can be useful.

But the human role sometimes exists specifically to slow the process down.

That may sound inefficient.

It is not.

A journalist may need to stop and read the original document.

An editor may need another source.

A claim may need to be softened.

A headline may need to be rewritten.

A story may need to wait.

The value of the human is not always acceleration.

Sometimes the value is friction.

Responsible friction prevents speed from turning into carelessness.

In an AI-assisted workflow, the pause can be as important as the prompt.

Judgment Is Not the Same as Being Right

There is another distinction worth making.

Human judgment does not mean human certainty.

A journalist can be biased.

An editor can make a poor decision.

A newsroom can fail.

Humans are not automatically more accurate simply because they are human.

The purpose of human oversight is not to replace machine error with human perfection.

It is to introduce accountability, context, professional standards and the ability to challenge the system.

Good judgment has to be disciplined.

It should be informed by evidence.

It should be open to correction.

It should recognize uncertainty.

It should be willing to change when better information appears.

The human role is valuable because accountable people and institutions have to remain responsible for consequential decisions.

The Organization Is Part of the Loop Too

It is easy to picture the “human in the loop” as one reporter sitting at a computer.

That is too narrow.

News organizations are part of the loop.

Editors are part of the loop.

Managers are part of the loop.

Policies are part of the loop.

Training is part of the loop.

The design of the workflow itself is part of the loop.

Not every AI failure is a failure of the individual journalist.

Sometimes the workflow itself is badly designed.

A reporter may follow the process exactly as instructed and still be set up to fail by weak training, unclear standards, poor tools or unrealistic deadlines.

If an organization introduces an AI tool without explaining its limits, that matters.

If employees are encouraged to use AI but are not given clear verification standards, that matters.

If the newsroom rewards speed while expecting careful oversight, that contradiction matters too.

A responsible AI workflow cannot depend entirely on an individual journalist catching every possible problem.

The organization has to create conditions that make good judgment possible.

Authority Has to Be Real

Formal authority on paper is not enough.

An organization can tell employees that they have the right to reject AI-generated work.

But what happens when somebody actually does it?

What happens when a reporter says:

This needs another source.

This output is unreliable.

This story is not ready.

This workflow is creating a problem.

If slowing down the process is punished, discouraged or treated as incompetence, then the journalist does not really have meaningful authority.

Real human control depends not only on approval rights.

It depends on whether the culture supports people who challenge, delay or reject AI-assisted work when necessary.

That may be one of the least visible parts of responsible AI use.

But it matters.

My Role in the Loop

This has become increasingly clear in my own work.

When I use AI, I am not simply waiting at the end of the process to approve whatever appears.

I am involved throughout it.

I decide what question to ask.

I decide what sources matter.

I decide when the AI has misunderstood the task.

I decide when an argument needs to be challenged.

I decide when something needs independent verification.

I decide whether the final language sounds like me.

I decide whether the work is ready.

That is what human oversight looks like in practice.

It is not one final approval button.

It is a series of decisions throughout the workflow.

Sometimes those decisions are small.

Sometimes they change the entire direction of the work.

The Human Should Not Be the Excuse

There is also a danger in using “human oversight” as a blanket defense.

An organization cannot simply say:

“There was a human in the loop.”

And assume that settles the question.

Was the human trained?

Did they understand the task and the limitations of the tool?

Did they have time to review the work?

Did they have access to the underlying evidence?

Could they reject the AI output?

If the answer to those questions is no, the presence of a human may not mean very much.

Human oversight should be something we can describe.

Not just something we claim exists.

A Better Question

Instead of asking:

“Is there a human in the loop?”

I think the better question is:

“Where does human judgment enter the process, and what authority does it have?”

That question forces us to look at the workflow more carefully.

Who verifies?

Who approves?

Who can stop publication?

Who decides whether a source is credible?

Who resolves conflicting information?

Who is responsible when something goes wrong?

Those questions matter more than whether a policy document contains the phrase “human in the loop.”

Human Control Does Not Mean Rejecting AI

None of this means journalists should avoid AI.

The lesson is not that human control requires manual work.

Chapter 2 established that responsibility does not require doing everything yourself.

Human control means knowing where AI can help and where accountable human judgment has to remain decisive.

AI may help surface possibilities.

The human decides which matter.

AI may help draft language.

The human decides what is accurate.

AI may help challenge an argument.

The human decides which criticism is valid.

AI may help identify a pattern.

The human decides whether the pattern is meaningful.

That is partnership without surrender.

The Final Decision Still Belongs Somewhere

Every workflow eventually reaches a point where something happens.

A story is published.

A claim is removed.

A headline is changed.

A source is rejected.

A correction is issued.

A story is held.

Artificial intelligence can influence those decisions.

It should not be allowed to make consequential editorial decisions without accountable human review.

Somebody — or some clearly defined editorial authority — has to own the final choice.

That ownership is what gives the phrase “human in the loop” meaning.

Without it, the human is simply present.

With it, the human has a responsibility to understand, challenge and intervene.

The goal is not merely to keep humans near artificial intelligence.

The goal is to keep human judgment, authority and accountability inside the process.

That is what the loop is supposed to protect.


Graphics created with AI-assisted design tools.
Visual concepts, editorial direction, composition, and final creative decisions were developed by Vallano Media.