用并行分治策略提升大范围搜索效率,让AI团队分工协作更快找全信息。
A-MapReduce: Executing Wide Search via Agentic MapReduce
- 将广度搜索转为横向并行任务,按需拆解并聚合结果
- 在5个基准上平均提升5.11%~17.50%的查准率,运行时间减少45.8%
- 适合需要快速覆盖大量信息的复杂研究或情报分析场景
当前基于大语言模型的多智能体系统在深度研究任务中表现优异,这类任务强调迭代、垂直结构的信息获取。然而,面对大规模、广度导向的检索任务时,现有以顺序、垂直推理为核心的智能体框架难以有效执行,陷入目标泛化与长周期效率低下的困境。为此,我们提出 A-MapReduce——一种受 MapReduce 模式启发的多智能体执行框架,将广度搜索重构为横向结构化的检索问题。具体而言,A-MapReduce 通过任务自适应分解实现海量检索目标的并行处理,并结合结构化结果聚合;同时利用经验记忆驱动查询条件下的任务分配与重组持续演化,从而在大规模广度搜索场景中实现渐进式优化。在五个智能体基准上的实验表明,A-MapReduce 在 WideSearch 与 DeepWideSearch 上均达到领先性能,相较使用 OpenAI o3 或 Gemini 2.5 Pro 的强基线,平均物品 F1 提升 5.11%–17.50%;且具备更优的成本-性能权衡,运行时间较代表性多智能体基线降低 45.8%。代码已开源:https://github.com/mingju-c/AMapReduce。
原文摘要 · Abstract (English)
Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks characterized by large-scale, breadth-oriented retrieval, existing agentic frameworks, primarily designed around sequential, vertically structured reasoning, remain stuck in expansive search objectives and inefficient long-horizon execution. To bridge this gap, we propose A-MapReduce, a MapReduce paradigm-inspired multi-agent execution framework that recasts wide search as a horizontally structured retrieval problem. Concretely, A-MapReduce implements parallel processing of massive retrieval targets through task-adaptive decomposition and structured result aggregation. Meanwhile, it leverages experiential memory to drive the continual evolution of query-conditioned task allocation and recomposition, enabling progressive improvement in large-scale wide-search regimes. Extensive experiments on five agentic benchmarks demonstrate that A-MapReduce is (i) high-performing, achieving state-of-the-art performance on WideSearch and DeepWideSearch, and delivering 5.11% - 17.50% average Item F1 improvements compared with strong baselines with OpenAI o3 or Gemini 2.5 Pro backbones; (ii) cost-effective and efficient, delivering superior cost-performance trade-offs and reducing running time by 45.8\% compared to representative multi-agent baselines. The code is available at https://github.com/mingju-c/AMapReduce.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。