arXiv:2507.03327cs.CLcs.AI2025-07被引 2

让大模型先静默阅读再回答,提升推理准确性。

Read Quietly, Think Aloud: Decoupling Comprehension and Reasoning in LLMs

  • 引入'阅读空间'或'阅读伙伴'架构,分离理解与生成阶段。
  • 在多个任务上实现显著准确率提升,最高达多点增长。
  • 适合需要深度推理的问答与逻辑任务场景。

大型语言模型(LLMs)在文本理解和高质量回应生成方面表现出色,但其缺乏人类认知中典型的静默阅读与思考阶段。本文研究如何为模型注入类似人类的内部处理能力。提出通过提供初始上下文提示或'阅读空间',让模型在生成最终输出前进行隐式理解。进一步设计'阅读伙伴'架构,由辅助模块静默处理输入并为生成模型提供优化后的上下文信息。实验表明,这些方法能显著提升模型性能,在多项任务中实现多点准确率提升。该策略推动了大模型向更类人化文本处理迈进。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated remarkable proficiency in understanding text and generating high-quality responses. However, a critical distinction from human cognition is their typical lack of a distinct internal `reading' or deliberation phase before `speaking' (i.e., generating text). Humans often engage in silent reading to comprehend context and formulate thoughts prior to articulation. This paper investigates methods to imbue LLMs with a similar capacity for internal processing. We introduce and evaluate techniques that encourage LLMs to `read silently.' Our findings indicate that even a straightforward approach, such as providing the model with an initial contextual prompt or `reading space' before it begins predicting subsequent tokens for the final output, can yield significant performance improvements. We further enhance this concept by developing a `reading buddy' architecture, where an auxiliary component silently processes the input and provides refined contextual insights to the primary generation model. These approaches aim to foster deeper understanding from LLMs so that they can produce better reasoned responses, moving them one step closer to more human-like text processing. Our results indicate that these simple techniques can provide surprisingly strong impact on accuracy with multiple point accuracy boost.

大模型推理增强阅读机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。