arXiv:2510.05746cs.AIcs.CL2025-10

用可演化推理模块提升多智能体系统通用性与性能。

ARM: Discovering Agentic Reasoning Modules for Generalizable Multi-Agent Systems

  • 通过树搜索演化出可执行的细粒度推理模块,替代传统链式思维。
  • 在多个任务上超越人工设计与现有自动方法,且无需重新训练。
  • 模块可跨模型、跨任务复用,适合需要高泛化能力的研究者。

基于大语言模型的多智能体系统(MAS)在复杂推理任务中已达到领先水平。近期工作尝试自动化设计MAS,但表现不佳,常逊于简单基线,且需为每个新领域重新发现架构和昂贵标注。关键洞察是:简单的链式思维(CoT)常能媲美复杂系统,提示应深入研究其基本推理单元。为此,我们提出新范式:聚焦优化CoT推理。引入代理式推理模块(ARM),将每个细粒度推理步骤交由专门模块执行,通过代码空间的树搜索演化生成,起点为简单CoT,利用执行轨迹反思指导突变。所得ARM可作为递归循环或学习型元调度器中的子程序使用。该方法显著优于人工设计及当前最优自动设计方法。关键优势在于,基于ARM构建的MAS在不同基础模型和任务域间展现出优异泛化能力,无需额外优化即可保持高性能。

原文摘要 · Abstract (English)

Large Language Model (LLM)-powered Multi-agent systems (MAS) have achieved state-of-the-art results on various complex reasoning tasks. Recent works have proposed techniques to automate the design of MASes, eliminating the need for manual engineering. However, these techniques perform poorly, often achieving similar or inferior performance to simple baselines. Furthermore, they require computationally expensive re-discovery of architectures for each new task domain and expensive data annotation on domains without existing labeled validation sets. A critical insight is that simple Chain of Thought (CoT) reasoning often performs competitively with these complex systems, suggesting that the fundamental reasoning unit of MASes, CoT, warrants further investigation. To this end, we present a new paradigm for automatic MAS design that pivots the focus to optimizing CoT reasoning. We introduce the Agentic Reasoning Module (ARM), an agentic generalization of CoT where each granular reasoning step is executed by a specialized reasoning module. This module is discovered through a tree search over the code space, starting from a simple CoT module and evolved using mutations informed by reflection on execution traces. The resulting ARM acts as a versatile reasoning building block which can be utilized as a direct recursive loop or as a subroutine in a learned meta-orchestrator. Our approach significantly outperforms both manually designed MASes and state-of-the-art automatic MAS design methods. Crucially, MASes built with ARM exhibit superb generalization, maintaining high performance across different foundation models and task domains without further optimization.

多智能体推理模块自动设计泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。