通过分步阅读提升大模型理解力,解决推理失败的根源问题
Read Before You Think: Mitigating LLM Comprehension Failures with Step-by-Step Reading
- 设计分步阅读提示,引导模型逐层解析问题
- 提升关键词出现频率可有效聚焦注意力,改善理解
- 针对解码器模型的依赖瓶颈,实现迭代重上下文优化
大型语言模型在复杂推理任务中常因理解错误而非逻辑缺陷而失败。本文系统研究此类理解失误,发现:(1)计算中的分步原则可迁移至阅读过程以增强理解;(2)增加问题相关词元比例(如重复)能通过显式控制重聚焦注意力;(3)反向依赖是解码器模型的核心瓶颈,即使使用链式思维等强方法仍存在。基于此,提出分步阅读(SSR)系列提示,其中SSR++通过多阶段设计,引导模型以更细粒度解析问题、聚焦关键词元,并通过迭代重上下文化解依赖。SSR++在多个推理基准上达到新SOTA,分析证实其通过直接缓解语义误解起效。结果表明,引导模型如何阅读是提升推理能力的有效且高效方法。
原文摘要 · Abstract (English)
Large Language Models (LLMs) often fail on complex reasoning tasks due to flawed question comprehension, not just flawed logic. This paper presents a systematic investigation into these comprehension failures. Our work yields three key insights: (1) the step-by-step principle, effective for calculation, can be migrated to the reading process to enhance comprehension; (2) increasing the proportion of question-related tokens (e.g., via repetition) succeeds by refocusing attention, a mechanism that can be explicitly controlled; and (3) backward dependencies represent a core bottleneck for decoder-only models that persists even with strong methods like Chain-of-Thought. Based on these findings, we introduce the Step-by-Step Reading (SSR) family of prompts. This multi-stage approach culminates in SSR++, a method specifically engineered to deepen model comprehension by guiding it to parse questions with finer granularity, focus attention on critical tokens, and resolve backward dependencies through iterative re-contextualization. SSR++ sets a new state-of-the-art on multiple reasoning benchmarks, and our analysis confirms it works by directly mitigating semantic misunderstanding. These results demonstrate that guiding how a model reads is a powerful and efficient method for improving its reasoning ability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。