arXiv:2605.04496cs.CL2026-05被引 1

SCOUT通过主动搜索关键信息,用更少计算实现长文本理解

SCOUT: Active Information Foraging for Long-Text Understanding with Decoupled Epistemic States

论文配图:SCOUT: Active Information Foraging for Long-Text Understanding with Decoupled Epistemic States
图 1 · 摘自论文原文
  • 将长文本视为可探索环境,动态聚焦查询相关片段
  • 相比顶尖模型减少8倍令牌消耗,且长度增加时性能更稳定
  • 适合需要高效处理海量文档的场景,如法律、科研分析

百万级令牌规模的长文本理解需平衡推理精度与计算效率。前沿长上下文大模型虽能端到端处理百万令牌,但存在高令牌消耗和注意力稀释问题;而专用长文本代理常通过图构建或索引等通用抽象牺牲精度。我们发现:查询相关的信息在全文中通常稀疏分布,有效推理应依赖查询充分的子集而非全部上下文。为此,提出SCOUT——一种从被动处理转向主动信息觅食的新范式。它将文档视为可探索环境,以紧凑、溯源可信的信念状态生成答案。基于状态层面的差距诊断,SCOUT自适应地在粗粒度到细粒度探索与锚定状态更新间交替,逐步收缩其信念状态至查询充分。实验表明,SCOUT在匹配现有专有模型表现的同时,令牌消耗最高降低8倍,且在上下文长度增长时仍保持稳定,显著缓解实际中的成本-性能权衡。

原文摘要 · Abstract (English)

Long-Text Understanding (LTU) at million-token scale requires balancing reasoning fidelity with computational efficiency. Frontier long-context LLMs can process millions of token contexts end-to-end, but they suffer from high token consumption and attention dilution. In parallel, specialized LTU agents often sacrifice fidelity through task-agnostic abstractions like graph construction or indexing. We identify a key insight for LTU: query-relevant information is typically sparse relative to the full document, so effective reasoning should rely on a query-sufficient subset rather than the entire context. To address this, we propose SCOUT, a new paradigm for LTU that shifts from passive processing to active information foraging. It treats the document as an explorable environment and answers from a compact, provenance-grounded epistemic state. Guided by state-level gap diagnosis, SCOUT adaptively alternates between coarse-to-fine exploration and anchored state updates that progressively contract its epistemic state toward query sufficiency. Experiments show that SCOUT matches state-of-the-art proprietary models while reducing token consumption by up to 8x. Moreover, SCOUT remains stable as context length scales, substantially alleviating the practical cost-performance trade-off.

长文本理解信息觅食推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。