给搜索代理的过时信息打码,能省上下文却未必有效。
Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanism

- 用打码方式删过时信息,换更多搜索轮次
- 强检索器+中等模型时效果最好,过大反而变差
- 适合做长程搜索的模型优化,尤其关注上下文效率
长周期搜索代理在多轮工具调用中积累大量检索内容,上下文预算效率愈发关键。一种简单方法是随轨迹推进屏蔽过时观测结果,但其何时有效仍不明确。本文系统评估了4B至284B参数的不同代理模型与三种检索器,在离线和实时网络搜索基准上的表现。发现屏蔽带来的准确率提升随无上下文管理模型的原始准确率呈非对称倒U形:弱检索器下平缓,强检索器搭配中等容量模型时达峰,模型过载后骤降。该模式源于检索召回率与模型隐式过滤能力的交互,而非单一因素。机制上,屏蔽相当于以令牌换轮次:移除模型已不再关注、且代理很少重开的页面。新增轮次在将失败转为成功时有效,但在误删模型本会使用的证据时失效。因此,我们重新将上下文管理视为依赖场景的干预,并提供分析智能搜索中上下文使用的整体视角。代码与轨迹数据已开源(https://github.com/i-DeepSearch/observation-masking)。
原文摘要 · Abstract (English)
Long-horizon search agents accumulate large amounts of retrieved content across many tool calls, making context-budget efficiency increasingly important. A minimal intervention is to mask stale observations from the context as the trajectory progresses, but it remains unclear when this form of context management helps and why. We study observation masking through a systematic sweep over various agent backbones (4B to 284B parameters) and three retrievers on offline and live-web agentic search benchmarks. We find that the accuracy gain from masking follows an asymmetric inverted-U shape when plotted against the model's accuracy without context management: a plateau under weak retrievers, a peak when a strong retriever meets a mid-capacity model, and a sharp collapse when the model is saturated. This pattern reflects the interaction between retriever recall and the model's implicit filtering capacity, rather than either factor in isolation. Mechanistically, masking implements a token-for-turn trade-off: it removes observations the model has largely stopped attending to and pages the agent rarely re-opens. The added turns help when they convert failures into successes, but they fail when masking removes evidence the model would otherwise have used. We therefore reframe context management as a regime-dependent intervention and provide a holistic perspective for analyzing context use in agentic deep search. We release our scaffold and trajectories here (https://github.com/i-DeepSearch/observation-masking) to support future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。