news LinkedIn

AI and Trust | Sofia Olofsson | 39 comments

A new paper from researchers at the University of Glasgow and the University of Sheffield argues that efforts to reduce AI hallucinations are focusing too narrowly on accuracy. The authors describe this as the “accuracy paradox”: regulators and developers treat accuracy scores as a proxy for truth, trustworthiness, and safety, but a model can still mislead users even when it performs well on benchmarks. The paper identifies three main risks. First, there is an epistemic problem: large language models generate plausible word sequences rather than reason toward truth, so they can combine real details into a false whole, such as fabricated academic citations. Second, accurate-looking systems can be used to manipulate users through framing, selective emphasis, tone, and sycophantic responses, which may increase trust without improving reliability. Third, optimizing for accuracy at scale can reinforce dominant viewpoints and reduce exposure to diverse or minority perspectives. The paper also argues that current governance frameworks are poorly suited to these harms. The EU AI Act, GDPR, and Digital Services Act all rely on accuracy in ways that do not fully address probabilistic outputs that are misleading without being outright false. Instead of treating accuracy as the main benchmark, the authors call for “epistemic trustworthiness”: systems should communicate uncertainty, reveal limits, and allow users to interrogate how answers were produced. The paper concludes that this is a harder standard to measure, but a more appropriate one for AI governance.

Build this article’s timeline

Extract dated events, key actors, and open questions using the same timeline analysis available in Signal.

Log in to build

Timeline generation is available to signed-in community members.

Five Ws 🤖 3 AI prefills · 2 still unanswered
Who
Zihao Li, Weiwei Y., Jiahong Chen, and University of Glasgow
🤖 AI prefill
What
A new paper from researchers at the University of Glasgow and the University of Sheffield argues that efforts to reduce AI hallucinations are focusing too narrowly on accuracy.
🤖 AI prefill
When When did this happen, or what is the timeframe?
Where Where did this occur?
Why
Centers on accuracy paradox, epistemic trustworthiness, and AI hallucination
🤖 AI prefill

Login to answer and earn XP for each gap you fill.

Accuracy Paradox accuracy, hallucination, benchmark, truth, risk Epistemic Harm epistemic, trustworthiness, uncertainty, autonomy, misleading Governance Gaps EU AI Act, GDPR, DSA, regulation, oversight Trustworthy AI Design uncertainty, provenance, traceability, interrogation, explanation
accuracy paradox100% epistemic trustworthiness98% AI hallucination96% large language models95% accuracy benchmarks91% epistemic autonomy90% probabilistic outputs88% fake academic citation87% sycophantic alignment84% EU AI Act83%
8
Manipulation Score: Low How much this article uses emotional framing vs. straight reporting
Loaded Language 625%
Absolutist 1015%
Threat/Panic 425%
Us vs Them 215%
Engagement Bait 1820%
Manipulation score look right?

Factual Claims (10)

medium scientific
A new paper from researchers at the University of Glasgow and the University of Sheffield argues we are fixing AI hallucination in the wrong way.
medium other
Regulators, developers, and oversight bodies have converged on accuracy as the primary measure of hallucination risk.
medium scientific
Higher accuracy scores mean lower hallucination rates and safer, more trustworthy AI.
medium scientific
A model can score well on accuracy benchmarks and still mislead, manipulate, and narrow the range of ideas users encounter.
medium technology
LLMs predict likely word sequences and do not reason toward truth.
low scientific
A fake academic citation can contain real authors and journals but a completely fabricated paper.
medium legal
The EU AI Act enshrines accuracy as a marker of trustworthiness but applies it only to high-risk systems.
medium legal
The GDPR's accuracy principle was built for deterministic, record-based systems and lacks a framework for probabilistic outputs that are misleading without being false.
medium legal
The DSA treats accuracy as a diagnostic metric rather than a normative standard.
medium scientific
The paper calls for a shift toward epistemic trustworthiness, including uncertainty communication and evaluation of how users can interrogate outputs.

Comments

Login to view and post comments.

🏠Portal 📰Links ❓Q&A 📅Events 💼Jobs