news LinkedIn

This one is going to make some noise. Just the way we like it. Because it brings the AI debate back to reality. Together with Gary Marcus and Valerio Capraro, we've just released a new paper: "Human… | Walter Quattrociocchi | 12 comments

Walter Quattrociocchi announces a paper co-authored with Gary Marcus and Valerio Capraro, titled “Human likeness is a misplaced benchmark for artificial intelligence.” The authors reassess claims that large language models have passed the Turing test and thereby demonstrated human-like intelligence. They reviewed 35 studies that used the Turing test or related methods to evaluate language models. Although 16 reported positive results, only three used the classical three-party version of the test, and just one reported a pass. In that study, GPT-4.5, specifically instructed to impersonate a human, was judged human in 73% of five-minute trials. The authors argue that producing human-like responses does not prove human-like intelligence. Surface similarity reveals little about whether a system can generalize reliably, recognize uncertainty, revise its approach, or adapt when circumstances change. They also question why human imitation should be the central measure of AI progress, given that humans are biased, inconsistent, manipulable, and often wrong. Instead, they propose evaluating AI according to measurable benefits, reliable generalization, independent judgment, effective error correction, and support for human autonomy and welfare. They warn that systems optimized for convincing impersonation may increase manipulation risks and encourage replacement rather than augmentation of human abilities. The accompanying comments broadly support this position, emphasizing that intelligence need not resemble biological cognition and that practical usefulness matters more than sounding human. Several commenters also distinguish successful imitation from genuine transformation, understanding, or thought.

Build this article’s timeline

Extract dated events, key actors, and open questions using the same timeline analysis available in Signal.

Log in to build

Timeline generation is available to signed-in community members.

Five Ws 🤖 4 AI prefills · 1 still unanswered
Who
Gary Marcus, Valerio Capraro, Alan Turing, and Sapienza University of Rome
🤖 AI prefill
What
Walter Quattrociocchi announces a paper co-authored with Gary Marcus and Valerio Capraro, titled “Human likeness is a misplaced benchmark for artificial intelligence.” The authors reassess claims that large language models have passed the…
🤖 AI prefill
When When did this happen, or what is the timeframe?
Where
Rome
🤖 AI prefill
Why
Centers on human likeness as a benchmark for artificial intelligence, Turing test, and large language models
🤖 AI prefill

Login to answer and earn XP for each gap you fill.

Turing Test Evidence Turing test, imitation game, GPT-4.5, human identification, 35 papers Beyond Human Likeness human likeness, intelligence benchmark, reliable generalization, adaptive reframing, error correction Human Fallibility And AI Risks bias, inconsistency, manipulation, human judgment, impersonation AI Human Benefit human welfare, human autonomy, measurable benefits, helpfulness, verification
human likeness as a benchmark for artificial intelligence99% Turing test98% large language models95% classical three-party Turing test92% GPT-4.5 human impersonation90% human-like intelligence91% reliable generalization90% independent judgment86% adaptive reframing82% human autonomy82%
24
Manipulation Score: Low How much this article uses emotional framing vs. straight reporting
Loaded Language 2425%
Absolutist 1815%
Threat/Panic 2025%
Us vs Them 1015%
Engagement Bait 4220%
Manipulation score look right?

Factual Claims (10)

medium scientific
The authors released a paper titled "Human likeness is a misplaced benchmark for artificial intelligence."
medium scientific
The paper examined 35 papers claiming to use the Turing test or a variation of it to evaluate large language models.
medium scientific
Sixteen of the examined papers reported positive results.
medium scientific
Only three of the 35 papers included the classical three-party Turing test.
medium scientific
Only one examined study reported passing the classical three-party Turing test.
high technology
In that study, GPT-4.5, explicitly prompted to impersonate a human, was identified as human in 73% of five-minute trials.
medium scientific
The authors' previous research, published in PNAS, found that human and artificial judgments can converge on similar answers while using different observable criteria.
medium scientific
Human-like outputs do not establish that an AI system can generalize reliably, recognize the limits of its knowledge, or reconsider its approach when circumstances change.
medium technology
Systems designed to convincingly impersonate people create new opportunities for manipulation.
medium scientific
The authors advocate measuring reliable generalization, independent judgment, human autonomy, and measurable benefits to people rather than human imitation.

Comments

Login to view and post comments.

🏠Portal 📰Links ❓Q&A 📅Events 💼Jobs