LLM检索需先去噪,否则会引发幻觉和推理错误。
LLM-Oriented Information Retrieval: A Denoising-First Perspective

- 以去噪为核心,提升上下文窗口中可用信息密度
- 提出四阶段检索挑战框架,涵盖从不可见到不可验证
- 适合构建智能代理、代码助手等依赖检索的系统
现代信息检索正越来越多地服务于大语言模型(LLMs),通过检索增强生成(RAG)和智能体搜索实现。与人类用户不同,LLMs受注意力预算限制,对噪声尤为敏感;无关或误导信息不再只是干扰,而是导致幻觉和推理失败的直接原因。本文认为,最大化可用证据密度和可验证性——即去噪——已成为信息访问全链路的核心瓶颈。我们提出一个四阶段框架:从不可访问到难以发现,再到语义错配,最终不可验证。此外,系统梳理了索引、检索、上下文工程、验证及智能体工作流中的信噪优化技术,并展示了在终身助手、代码智能体、深度研究和多模态理解等高依赖检索场景中的去噪研究成果。
原文摘要 · Abstract (English)
Modern information retrieval (IR) is no longer consumed primarily by humans but increasingly by large language models (LLMs) via retrieval-augmented generation (RAG) and agentic search. Unlike human users, LLMs are constrained by limited attention budgets and are uniquely vulnerable to noise; misleading or irrelevant information is no longer just a nuisance, but a direct cause of hallucinations and reasoning failures. In this perspective paper, we argue that denoising-maximizing usable evidence density and verifiability within a context window-is becoming the primary bottleneck across the full information access pipeline. We conceptualize this paradigm shift through a four-stage framework of IR challenges: from inaccessible to undiscoverable, to misaligned, and finally to unverifiable. Furthermore, we provide a pipeline-organized taxonomy of signal-to-noise optimization techniques, spanning indexing, retrieval, context engineering, verification, and agentic workflow. We also present research works on information denoising in domains that rely heavily on retrieval such as lifelong assistant, coding agent, deep research, and multimodal understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。