arXiv:2602.07213cs.LG2026-02被引 1

模型决定不查资料时,反而推理更准,说明知道‘不知道’才是关键。

Adaptive Retrieval helps Reasoning in LLMs -- but mostly if it's not used

  • 让模型自己判断何时查外部知识,实现动态推理。
  • 不调用检索的推理路径表现优于传统链式思维,仅少数情况需检索。
  • 模型越难越爱查资料,决策本身是可信度信号,适合做高可靠AI系统。

大语言模型在复杂推理任务中常因静态参数化知识而出现幻觉或表现不佳,尤其在数学等专业领域。本文探索将检索视为动态上下文学习的机制,测试一种自适应检索增强架构:让大模型代理在推理过程中自主决定是否查询外部知识库。在GSM8K和MATH-500基准上对比标准链式思维(CoT)与静态检索策略。结果显示,尽管静态检索劣于CoT,但自适应检索呈现反直觉现象:包含检索结果的推理路径性能略差于CoT,而未使用检索的路径反而表现更优。这表明:(a) 检索仅极少情况下对推理有帮助(如引用有效定理);(b) 主动不检索反而是模型能力良好的标志。此外,模型会随问题难度提高检索频率,验证了检索决策本身是一种关键元认知信号。模型自我评估知识边界并选择性接入外部信息,是构建更鲁棒生成模型的核心原则。

原文摘要 · Abstract (English)

Large Language Models (LLMs) often falter in complex reasoning tasks due to their static, parametric knowledge, leading to hallucinations and poor performance in specialized domains like mathematics. This work explores a fundamental principle for enhancing generative models: treating retrieval as a form of dynamic in-context learning. We test an adaptive retrieval-augmented architecture where an LLM agent actively decides when to query an external knowledge base during its reasoning process. We compare this adaptive strategy against a standard Chain-of-Thought (CoT) baseline and a static retrieval approach on the GSM8K and MATH-500 benchmarks. Although our experiments show that static retrieval is inferior to CoT, the adaptive retrieval shows interesting behavior: While traces including retrieved results show slightly worse performance compared to CoT, traces that do not include retrieval actually perform better compared to CoT. This suggests that: (a) retrieval only rarely helps reasoning (we show a few counterexamples, e.g. using useful theorems) and (b) actively not using retrieval is indicative of good model performance. Furthermore, we find that the model scales its retrieval frequency with the difficulty of the problem, reinforcing that the decision to retrieve is a crucial metacognitive signal. The agent's ability to self-assess its knowledge and selectively engage with external information represents a key principle for building more robust and reliable generative models.

大模型推理自适应检索元认知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。