解决长轨迹智能搜索的上下文瓶颈,用分步检索+定期摘要提升效率。
Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
- 拆分搜索与浏览工具,周期性总结轨迹,保持上下文简洁。
- 在多个任务上以4-6倍少的调用次数达成更高准确率。
- 适合需要高效长流程推理的研究系统开发者。
长时序智能搜索需在多轮网页探索中整合大量信息,支持深度研究等应用。本文指出当前主流框架难以扩展至长轨迹,主要受限于上下文窗口和工具预算,且易积累冗余噪声或提前终止。为此提出SLIM(轻量信息管理)框架,将检索分为独立的搜索与浏览工具,并周期性汇总轨迹内容,在保持上下文紧凑的同时支持更长、更聚焦的搜索。在多种长时序任务中,SLIM以显著更低的成本和工具调用次数达到媲美甚至超越强开源框架的表现。使用o3模型时,其在BrowseComp上达56%,在HLE上达33%,分别领先其他开源框架8和6个百分点,且工具调用减少4-6倍;使用GLM-4.7 Flash时,在BrowseComp上比次优开源框架Search-o1高出10个百分点,成本仅为三分之一。为深入理解失败模式,我们构建了细粒度轨迹分析管道与错误分类体系,发现SLIM的幻觉现象显著低于先前系统。希望该分析框架与简单设计能推动未来长时序智能体发展。
原文摘要 · Abstract (English)
Long-horizon agentic search requires iteratively exploring the web over long trajectories and synthesizing information across many sources, enabling powerful applications like deep research systems. In this work, we show that popular agentic search frameworks struggle to scale to long trajectories primarily due to context limitations--they accumulate long, noisy content, hit context window and tool budgets, or stop early. We therefore introduce SLIM (Simple Lightweight Information Management), a simple framework that separates retrieval into distinct search and browse tools, and periodically summarizes the trajectory, keeping context concise while enabling longer, more focused searches. Across a wide range of long-horizon tasks, SLIM achieves comparable performance at substantially lower cost and far fewer tool calls than strong open-source frameworks with both proprietary and open-weight models, including RL-trained models for deep research. Specifically, with o3 as the base model, SLIM achieves 56% on BrowseComp and 33% on HLE, outperforming all open-source frameworks by 8 and 6 absolute points, respectively, while incurring 4-6x fewer tool calls. With GLM-4.7 Flash, SLIM achieves 10 points improvement over the next best open-source framework, Search-o1, on BrowseComp using a third of the cost. To systematically understand failure modes in long-horizon agentic search, we develop an automated fine-grained trajectory analysis pipeline and error taxonomy, and find that SLIM exhibits significantly fewer hallucinations than prior systems. We hope our analysis framework and simple tool design inform future long-horizon agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。