arXiv:2601.22984cs.AI2026-01被引 3

诊断深度研究代理的幻觉问题,揭示其在研究过程中的错误积累机制。

Why Your Deep Research Agent Fails? On Hallucination Evaluation in Full Research Trajectory

  • 提出全流程审计框架,识别研究中四类幻觉:传播、意图、噪声与基底错误。
  • 构建100个高风险任务数据集,发现六种主流模型仍存在显著可靠性缺陷。
  • 适合研究大模型推理、智能搜索与可信赖AI系统的开发者参考。

诊断深度研究代理(DRAs)的失败模式仍是关键挑战。现有基准多依赖端到端评估,掩盖了研究轨迹中逐步积累的中间幻觉。为此,我们提出从结果导向转向过程感知评估,通过审计完整的研究计划-搜索-总结流程来检测幻觉。引入PING分类法,将DRA幻觉分为四类互补类型:传播性、意图性、噪声诱导和基底性。进一步将其细化为细粒度评估框架,将研究轨迹分解为原子动作、断言和子查询,实现严格验证。利用该框架分离出100个具有代表性的幻觉易发任务,包括对抗场景,构建DeepHalluBench数据集。对六种代表性DRAs的实验表明,在我们的幻觉敏感压力测试集上,所有系统仍存在不可忽视的可靠性差距。诊断分析揭示这些失败源于系统性缺陷,尤其是幻觉传播与认知偏见,为未来架构优化提供可操作洞察。代码与数据已开源于https://github.com/yuhao-zhan/DeepHalluBench。

原文摘要 · Abstract (English)

Diagnosing failure patterns in Deep Research Agents (DRAs) remains a critical challenge. Existing benchmarks predominantly rely on end-to-end evaluation, obscuring intermediate hallucinations that accumulate throughout the research trajectory. To bridge this gap, we propose a shift from outcome-based to processaware evaluation by auditing hallucinations in the full plan-search-summarize trajectory. We introduce the PING Taxonomy, which categorizes DRA hallucinations into four complementary types: Propagation, Intent, Noiseinduced, and Grounding. We further instantiate this taxonomy into a fine-grained evaluation framework that decomposes trajectories into atomic actions, claims, and sub-queries for rigorous verification. Leveraging this framework to isolate 100 distinctively hallucinationprone tasks including adversarial scenarios, we curate DeepHalluBench. Experiments on six representative DRAs show that, on our hallucination-prone stress-test set, all evaluated systems still exhibit non-negligible reliability gaps. Furthermore, our diagnostic analysis traces these failures to systemic deficits, especially hallucination propagation and cognitive biases, providing actionable insights for future architectural optimization. Code and data are available in https://github.com/yuhao-zhan/DeepHalluBench.

幻觉检测研究代理评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。