解决大模型研究代理因自我偏见导致判断失准的问题。
From Inertia to Objectivity: Improving Deep Research Agents with Noise Isolation

- 在关键决策点实施上下文隔离,抑制自我行动带来的偏见。
- 在多个基准上表现优异,同时降低33%的令牌消耗。
- 可训练小型模型达到GPT-4o水平,适合资源受限场景。
基于大语言模型的网络搜索代理在深度研究任务中展现出巨大潜力,但普遍存在一种反复出现的失效模式:一旦代理生成了查询、计划或中间结论,其后续对自身行为后果的判断会变得不够客观。我们称此为惯性偏见。为此,我们提出了IBIS基准,通过控制搜索观察结果,对比模型评估自身先前行为与外部行为的差异。实验表明,当模型“拥有”前序搜索步骤时,判断性能显著下降,说明自创行为历史会系统性扭曲后续判断。该偏见还会引发两类系统级退化:工作者层面的搜索噪声和管理者层面的上下文噪声。为此,我们提出NIS-Agent,分别在网页筛选和最终答案验证两个最易受惯性偏见影响的决策点应用上下文隔离。在GAIA、WebWalkerQA、BrowseComp和BrowseComp-zh四个基准上,NIS-Agent表现相当,同时相比基线减少33%的令牌消耗。我们还训练了一个8B模型,使其内在更抗惯性偏见;在相同NIS-Agent框架下,其平均表现接近GPT-4o水平。代码已公开于https://github.com/PangSMPang/NIS-Agent。
原文摘要 · Abstract (English)
Web search agents powered by Large Language Models (LLMs) show strong promise, but deep research tasks expose a recurring failure mode: once an agent has produced a query, plan, or intermediate conclusion, it becomes less objective when later judging the consequences of that same action. We term this phenomenon inertia bias. To make it measurable, we introduce the IBIS benchmark, which controls the search observations while varying whether the model is evaluating the outcome of its own prior action. We find that models are substantially worse when they "own" the preceding search step, showing that self-authored action history can systematically distort subsequent judgment. We further show that this bias propagates into two forms of system-level degradation: search noise at the worker level and contextual noise at the manager level. To address this problem, we propose NIS-Agent, which applies context isolation at the two decision points most vulnerable to inertia bias: webpage triage and final-answer validation. Across GAIA, WebWalkerQA, BrowseComp, and BrowseComp-zh, NIS-Agent achieves competitive performance while reducing token cost by 33% compared to our baseline. We further train an 8B model to be intrinsically more resistant to inertia bias; under the same NIS-Agent framework, it attains average performance comparable to GPT-4o on deep research benchmarks. Our code is publicly available at https://github.com/PangSMPang/NIS-Agent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。