arXiv:2510.26144cs.AI2025-10被引 17

用大模型与进化搜索结合,自动解决复杂科研工程问题。

The FM Agent

  • 大模型推理+进化采样,实现从零开始的自主优化
  • 在多个基准上达最新水平,最高提速20倍
  • 适合企业研发与科学探索,可大幅加速创新

大型语言模型正推动自主AI研究代理的发展。我们提出FM Agent,一种通用多代理框架,融合基于大模型的推理与大规模进化搜索,以应对复杂的现实挑战。其核心包含:1)融入专家指导的冷启动初始化阶段;2)用于迭代优化的新颖进化采样策略;3)结合正确性、有效性与大模型监督反馈的领域特定评估器;4)基于Ray构建的分布式异步执行基础设施。系统在运筹学、机器学习、GPU内核优化及经典数学问题等多个领域验证,实现无需人工干预或调参的最先进性能——ALE-Bench达1976.3分(+5.2%),MLE-Bench达43.56%(+4.0个百分点),内核优化最高提速20倍,并在多个经典数学问题上建立新SOTA。除学术基准外,该系统在大规模企业研发与基础科学研究中亦具显著潜力,可加速创新、自动化复杂发现流程,推动工程与科学进步,产生广泛社会影响。

原文摘要 · Abstract (English)

Large language models (LLMs) are catalyzing the development of autonomous AI research agents for scientific and engineering discovery. We present FM Agent, a novel and general-purpose multi-agent framework that leverages a synergistic combination of LLM-based reasoning and large-scale evolutionary search to address complex real-world challenges. The core of FM Agent integrates several key innovations: 1) a cold-start initialization phase incorporating expert guidance, 2) a novel evolutionary sampling strategy for iterative optimization, 3) domain-specific evaluators that combine correctness, effectiveness, and LLM-supervised feedback, and 4) a distributed, asynchronous execution infrastructure built on Ray. Demonstrating broad applicability, our system has been evaluated across diverse domains, including operations research, machine learning, GPU kernel optimization, and classical mathematical problems. FM Agent reaches state-of-the-art results autonomously, without human interpretation or tuning -- 1976.3 on ALE-Bench (+5.2\%), 43.56\% on MLE-Bench (+4.0pp), up to 20x speedups on KernelBench, and establishes new state-of-the-art(SOTA) results on several classical mathematical problems. Beyond academic benchmarks, FM Agent shows considerable promise for both large-scale enterprise R\&D workflows and fundamental scientific research, where it can accelerate innovation, automate complex discovery processes, and deliver substantial engineering and scientific advances with broader societal impact.

AI代理进化计算自动优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。