arXiv:2507.14393cs.AI2025-07被引 2

通过自动构建推理流程,让模型更聪明地解题。

Adaptive Multi-Agent Reasoning via Automated Workflow Generation

  • 根据问题自动生成推理路径和工具组合。
  • 在逻辑题上比Gemini等模型高66%准确率。
  • 适合需要强泛化能力的复杂推理任务。

大型推理模型(LRMs)有望显著提升语言模型的能力,以更高效率和准确性应对日益复杂的任务。然而,尽管表现优异,现有推理模型在面对新问题时常因记忆已有解法而非真正推理而失败,暴露出过拟合问题,导致泛化能力差。本文提出Nexus Architect,作为多智能体框架Nexus的升级版,引入自动化工作流生成机制。给定用户提问和少量示例,Architect能自主选择合适策略、工具集成与对抗技术,为特定问题类定制推理流程。同时,系统包含迭代提示优化机制,持续调优智能体提示以提升性能和泛化能力。我们在一个自定义的挑战性逻辑题数据集上,使用非推理型基础模型进行评估,结果表明Nexus Architect在多个指标上均超越现有先进模型:相比Gemini 2.5 Flash Preview pass率提升最高达66%,较Claude Sonnet 4和DeepSeek-R1提升近2.5倍,较Llama 4 Scout提升超3倍。

原文摘要 · Abstract (English)

The rise of Large Reasoning Models (LRMs) promises a significant leap forward in language model capabilities, aiming to tackle increasingly sophisticated tasks with unprecedented efficiency and accuracy. However, despite their impressive performance, recent studies have highlighted how current reasoning models frequently fail to generalize to novel, unseen problems, often resorting to memorized solutions rather than genuine inferential reasoning. Such behavior underscores a critical limitation in modern LRMs, i.e., their tendency toward overfitting, which in turn results in poor generalization in problem-solving capabilities. In this paper, we introduce Nexus Architect, an enhanced iteration of our multi-agent system framework, Nexus, equipped with a novel automated workflow synthesis mechanism. Given a user's prompt and a small set of representative examples, the Architect autonomously generates a tailored reasoning workflow by selecting suitable strategies, tool integrations, and adversarial techniques for a specific problem class. Furthermore, the Architect includes an iterative prompt refinement mechanism that fine-tunes agents' system prompts to maximize performance and improve the generalization capabilities of the system. We empirically evaluate Nexus Architect by employing an off-the-shelf, non-reasoning model on a custom dataset of challenging logical questions and compare its performance against state-of-the-art LRMs. Results show that Nexus Architect consistently outperforms existing solutions, achieving up to a 66% increase in pass rate over Gemini 2.5 Flash Preview, nearly 2.5$\times$ against Claude Sonnet 4 and DeepSeek-R1, and over 3$\times$ w.r.t. Llama 4 Scout.

多智能体自动推理逻辑题

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。