让AI搜索具备像人一样的自我监控能力,提升复杂任务的可靠性。
Deep Search with Hierarchical Meta-Cognitive Monitoring Inspired by Cognitive Neuroscience
- 引入快慢双通道监控机制,实时检测推理与证据的一致性。
- 在多个基准上显著提升搜索成功率和鲁棒性,表现优于基线模型。
- 适合需要长期推理与高可靠性的智能搜索系统开发者参考。
由大语言模型驱动的深度搜索代理在多步检索、推理和长周期任务执行中表现出强大能力,但其实际失败常源于缺乏对推理与检索状态的动态监控与调控机制。认知神经科学提示,人类元认知具有层次结构,能快速检测异常,并在必要时触发基于经验的反思。本文提出深度搜索元认知监控框架(DS-MCM),集成快速一致性监测器(轻量级检查外部证据与内部推理置信度的一致性)与慢速经验驱动监测器(基于历史代理轨迹的经验记忆,选择性激活以指导修正干预)。通过将监控嵌入推理-检索循环,DS-MCM可判断何时需干预,并如何依据过往经验制定修正策略。在多个深度搜索基准与主干模型上的实验表明,DS-MCM能持续提升性能与鲁棒性。
原文摘要 · Abstract (English)
Deep search agents powered by large language models have demonstrated strong capabilities in multi-step retrieval, reasoning, and long-horizon task execution. However, their practical failures often stem from the lack of mechanisms to monitor and regulate reasoning and retrieval states as tasks evolve under uncertainty. Insights from cognitive neuroscience suggest that human metacognition is hierarchically organized, integrating fast anomaly detection with selectively triggered, experience-driven reflection. In this work, we propose Deep Search with Meta-Cognitive Monitoring (DS-MCM), a deep search framework augmented with an explicit hierarchical metacognitive monitoring mechanism. DS-MCM integrates a Fast Consistency Monitor, which performs lightweight checks on the alignment between external evidence and internal reasoning confidence, and a Slow Experience-Driven Monitor, which is selectively activated to guide corrective intervention based on experience memory from historical agent trajectories. By embedding monitoring directly into the reasoning-retrieval loop, DS-MCM determines both when intervention is warranted and how corrective actions should be informed by prior experience. Experiments across multiple deep search benchmarks and backbone models demonstrate that DS-MCM consistently improves performance and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。