“Large Language Model Reasoning Failures,” submitted to arXiv in February 2026 by Peiyang Song, Pengrui Han, and Noah Goodman, presents a comprehensive survey of why large language models (LLMs) sometimes fail to reason correctly, even on apparently simple tasks. The paper argues that, despite major advances and strong performance across many applications, LLM reasoning remains unreliable and requires systematic study.
The authors introduce a two-dimensional framework for organizing existing research. The first dimension categorizes reasoning itself as embodied or non-embodied. Non-embodied reasoning is further divided into informal reasoning, involving intuition and everyday judgments, and formal reasoning, involving logic and structured inference. The second dimension classifies failures by their scope: fundamental failures rooted in LLM architectures and likely to affect many downstream tasks; application-specific limitations that arise in particular domains; and robustness failures, in which small changes to prompts, wording, or inputs produce inconsistent outcomes.
For each category, the survey defines the problem, reviews relevant studies, examines possible causes, and discusses mitigation strategies. Its central contribution is to unify previously fragmented research into a structured account of systemic weaknesses in LLM reasoning. The authors aim for this framework to help researchers compare findings, diagnose failure modes, and develop models with stronger, more dependable reasoning abilities. They also provide a curated collection of related research through an accompanying GitHub repository, creating an accessible starting point for further investigation. The paper was published in TMLR 2026 with Survey Certification.
Article timeline
Build this article’s timeline
Extract dated events, key actors, and open questions using the same timeline analysis available in Signal.
“Large Language Model Reasoning Failures,” submitted to arXiv in February 2026 by Peiyang Song, Pengrui Han, and Noah Goodman, presents a comprehensive survey of why large language models (LLMs) sometimes fail to reason correctly, even on…
🤖 AI prefill
📅When
5 February 2026 and 2026
🤖 AI prefill
📍WhereWhere did this occur?
💡Why
Centers on large language model reasoning failures, reasoning failure categorization framework, and embodied reasoning
🤖 AI prefill
Login to answer and earn XP for each gap you fill.
Comments
Login to view and post comments.