Human Signals
Report 03Free

When Humans Trust Machines

Confidence, dependence and judgement in the age of AI advice

A Human Signals report on trust calibration: why convincing AI is not always trustworthy AI, and why scepticism is not the same as wisdom.

Author

Alok Jha

Reading

5 min read

Volume

Reports · Volume 1

Download free →

You ask an AI a question you know reasonably well. It answers smoothly, with structure, examples and a tone of certainty. Something in the answer feels wrong. You check. It is wrong.

Then comes the strange part: for a few seconds, you doubted yourself before you doubted the machine.

AI has introduced a new psychological problem. We are no longer asking only whether machines can make good decisions. We are asking whether humans can judge when a machine deserves to be trusted.

Trust is not the same as trustworthiness

A 2026 review in Nature Reviews Psychology makes a crucial distinction: trust, trustworthiness and trusting behaviour are not the same thing. A system can be technically competent yet poorly trusted. It can also be confidently trusted when it should not be.

This sounds obvious, but everyday AI design blurs the distinction. Fluent language feels like competence. Fast responses feel like confidence. Detailed explanations feel like evidence. Human beings are used to reading social cues from other people; AI presents a new bundle of cues that can feel meaningful even when they are generated rather than experienced.

A quiet question How much of your trust in an AI answer comes from what it knows — and how much comes from how confidently it speaks?

Why machines can feel unusually certain

Humans reveal uncertainty in small ways: pauses, hesitation, facial expressions, "I'm not sure," a change of tone. AI can deliver a weak answer with the same polished syntax as a strong one. That consistency can be useful, but it removes natural uncertainty cues.

A 2026 Scientific Reports experiment found that participants who held more positive attitudes toward AI guidance could perform worse at distinguishing real from AI-synthesised faces when the guidance itself was unreliable. The lesson is not that positive attitudes toward AI are bad. It is that confidence in the source can change how carefully we inspect the underlying evidence.

The danger is not trust. The danger is trust that is poorly calibrated to the quality of the task, the system and the evidence.

Automation bias: the shortcut we do not notice

Automation bias is the tendency to rely too heavily on automated recommendations, especially when checking them requires effort. A 2025 review of human–AI collaboration found that automation bias is shaped by more than simple "trust": AI literacy, expertise, cognitive profile, verification demands and explanation complexity all matter.

Consider a finance team using AI to classify expenses. If the system is usually right, reviewing every line feels wasteful. Gradually, review becomes ceremonial. Then the system makes an unusual error — precisely the kind of case humans assumed automation would handle.

High accuracy can paradoxically create low vigilance. The better a system becomes, the harder it is to remain alert for the rare case where it fails.

A quiet question If a tool is right 98 times out of 100, how do you design behaviour for the two times that matter?

The seduction of explanation

We often assume an explainable AI must be more trustworthy. But explanations themselves can become persuasive objects. A plausible explanation can increase confidence even when the recommendation is weak. The important question is whether the explanation helps the user independently verify the output, not whether it merely sounds transparent.

"Because your previous purchases indicate a preference for…" is an explanation. It may also be a persuasion device. "Based on these three data points; confidence is moderate; here are two alternatives" supports a different kind of judgement. One tells you why to believe. The other gives you material with which to decide whether belief is justified.

AI changes the cost of thinking

Cognitive offloading is not new. We use calendars so we do not remember dates, calculators so we do not perform arithmetic, maps so we do not memorise routes. Offloading is one reason civilisation works: tools allow attention to move to higher-value problems.

Generative AI is different mainly in breadth. It can draft, summarise, compare, calculate, brainstorm and recommend. A 2026 review on AI overdependence describes growing concern about cognitive effects when people stop engaging deeply with tasks that previously required active reasoning.

The right question is therefore not "Does AI make us lazy?" That is too moralistic. A better question is: "Which parts of thinking should be offloaded, and which parts should remain deliberately effortful because the effort itself develops judgement?"

A quiet question If AI writes the first draft, identifies the options, ranks them and recommends one — which part of the decision is still yours?

Trust should change with the stakes

We already do this with humans. We may trust a friend's restaurant recommendation without asking for credentials. We would not use the same standard for a cardiac diagnosis. Yet AI's interface often looks identical across trivial and consequential tasks.

Low-stakes use can tolerate more convenience and less verification. High-stakes decisions demand stronger evidence, source checking and human accountability. The problem is that psychological convenience does not automatically adjust itself to stakes. Once a tool becomes habitual, we may carry the same casual trust into more serious contexts.

A useful mental rule is to separate idea generation from decision authority. AI can be excellent at expanding possibilities. The person or institution still needs to own the judgement, especially where errors affect health, rights, money, safety or reputation.

Scepticism can also become a bias

There is an equal and opposite mistake: rejecting good machine advice merely because it came from a machine. Research on algorithm aversion has shown that people can become disproportionately distrustful after observing an algorithm make mistakes, even when it remains more accurate than humans overall.

So the answer is not "trust humans." Humans are biased, inconsistent and sometimes confidently wrong. The goal is calibrated reliance: neither blind acceptance nor reflexive rejection.

Mature AI use will require a skill that sounds simple but is psychologically difficult: changing our level of trust when the evidence changes.

What calibrated trust might look like

Before accepting an AI recommendation, it helps to ask four quiet questions. What kind of task is this? How costly would an error be? Can I inspect the evidence or source? Am I using the AI because it is better at this problem — or because thinking for myself is inconvenient right now?

Organisations will need to build this into process, not just training. High-stakes AI workflows should make uncertainty visible, preserve an audit trail, define when human review is mandatory and avoid designing interfaces that make machine recommendations feel like final answers by default.

Individuals need an equivalent habit. Sometimes the best prompt is not "Give me the answer." It is "Show me what I might be missing."

What this leaves us with

A quiet question What is one task in your life where AI has become so convenient that you now check it less carefully than you did six months ago?

Selected evidence and further reading

Everett, J. A. C., Claessens, S., Knöchel, T.-D., et al. (2026). Principles for understanding trust in artificial intelligence. Nature Reviews Psychology, 5, 388–401. https://www.nature.com/articles/s44159-026-00562-1

Pearson, J., Dror, I. E., Jayes, E., et al. (2026). Examining human reliance on artificial intelligence in decision making. Scientific Reports, 16, 5345. https://www.nature.com/articles/s41598-026-34983-y

Romeo, G., & Conti, D. (2025/2026). Exploring automation bias in human–AI collaboration: a review and implications for explainable AI. AI & Society. https://doi.org/10.1007/s00146-025-02422-7

Ng, S. W. T., & Zhang, R. (2025). Trust in AI chatbots: A systematic review. Telematics and Informatics, 97, 102240. https://doi.org/10.1016/j.tele.2025.102240

Wirz, C. D., et al. (2025). (Re)Conceptualizing trustworthy AI: A foundation for change. Artificial Intelligence, 342, 104309. https://doi.org/10.1016/j.artint.2025.104309

AI-overdependence and human cognitive decline: Hazards, evidence, and mitigation strategies. (2026). Computers in Human Behavior Reports, 22, 101102. https://doi.org/10.1016/j.chbr.2026.101102

When Humans Trust Machines

Free to download. Part of the Human Signals Founding Reports series.

Download Free →