arXiv:2506.14234cs.CLcs.AI2025-06被引 12

让大模型像奥赛团队一样积累经验,边做题边学习。

Xolver: Multi-Agent Reasoning with Holistic Experience Learning Just Like an Olympiad Team

  • 用多智能体协作和持续记忆,让模型从经验中学习而非每次都重来。
  • 在多个数学与编程竞赛数据集上刷新纪录,最高达99.8%正确率。
  • 无需训练即可提升性能,适合追求高效推理的开发者使用。

尽管复杂推理取得显著进展,当前大型语言模型(LLMs)通常孤立运行——将每个问题视为独立尝试,无法积累或整合经验知识。相比之下,奥赛或编程竞赛团队等专家解题者会利用丰富的经验:从教练处汲取指导、通过过往题目培养直觉、掌握工具与库的使用方法、根据同伴专长调整策略、在试错中不断优化推理,并在竞赛期间学习相关问题。我们提出Xolver,一种无需训练的多智能体推理框架,为黑盒大模型赋予持久且动态演化的整体经验记忆。Xolver融合多种经验模态,包括外部与自检索、工具使用、协作互动、智能体驱动评估及迭代优化。通过在推理时学习相关策略、代码片段与抽象推理模式,避免从零生成解决方案,标志着从孤立推理向经验感知语言代理的转变。基于开源与专有模型构建,Xolver持续超越专用推理代理。即使使用轻量级主干模型(如QWQ-32B),其表现也常优于Qwen3-235B、Gemini 2.5 Pro、o3和o4-mini-high。在o3-mini-high上,其在GSM8K(98.1%)、AIME'24(94.4%)、AIME'25(93.7%)、Math-500(99.8%)和LiveCodeBench-V5(91.6%)上达到新最优结果,凸显整体经验学习是迈向具备专家级推理能力通用代理的关键一步。代码与数据见https://kagnlp.github.io/xolver.github.io/。

原文摘要 · Abstract (English)

Despite impressive progress on complex reasoning, current large language models (LLMs) typically operate in isolation - treating each problem as an independent attempt, without accumulating or integrating experiential knowledge. In contrast, expert problem solvers - such as Olympiad or programming contest teams - leverage a rich tapestry of experiences: absorbing mentorship from coaches, developing intuition from past problems, leveraging knowledge of tool usage and library functionality, adapting strategies based on the expertise and experiences of peers, continuously refining their reasoning through trial and error, and learning from other related problems even during competition. We introduce Xolver, a training-free multi-agent reasoning framework that equips a black-box LLM with a persistent, evolving memory of holistic experience. Xolver integrates diverse experience modalities, including external and self-retrieval, tool use, collaborative interactions, agent-driven evaluation, and iterative refinement. By learning from relevant strategies, code fragments, and abstract reasoning patterns at inference time, Xolver avoids generating solutions from scratch - marking a transition from isolated inference toward experience-aware language agents. Built on both open-weight and proprietary models, Xolver consistently outperforms specialized reasoning agents. Even with lightweight backbones (e.g., QWQ-32B), it often surpasses advanced models including Qwen3-235B, Gemini 2.5 Pro, o3, and o4-mini-high. With o3-mini-high, it achieves new best results on GSM8K (98.1%), AIME'24 (94.4%), AIME'25 (93.7%), Math-500 (99.8%), and LiveCodeBench-V5 (91.6%) - highlighting holistic experience learning as a key step toward generalist agents capable of expert-level reasoning. Code and data are available at https://kagnlp.github.io/xolver.github.io/.

多智能体经验学习推理增强数学竞赛

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。