arXiv:2603.29640cs.AI2026-03被引 5

AI用AI自我进化,实现模型、数据、算法三方面突破。

ASI-Evolve: AI Accelerates AI

  • 构建闭环研究框架,融合认知库与分析器提升探索效率。
  • 发现105个顶尖线性注意力架构,性能超越人类设计3倍以上。
  • 在数学与生物医药领域验证了跨栈迁移潜力,适合自研团队参考。

AI能否加速AI自身发展?尽管近期代理系统在短周期任务中表现优异,但其在高成本、长周期、弱监督的研究循环中的能力仍不明确。我们提出ASI-Evolve,一种用于AI-for-AI研究的代理框架,通过学习-设计-实验-分析的闭环实现自我进化。该框架在标准演化代理基础上引入两个关键组件:一个注入人类先验知识的认知库,以及一个将复杂实验结果提炼为可复用洞见的专用分析器。据我们所知,ASI-Evolve是首个统一展示AI驱动发现的框架,覆盖了AI发展的三大核心:数据、架构和学习算法。在神经网络架构设计中,它发现了105个SOTA线性注意力架构,最佳模型性能超越DeltaNet +0.97点,接近人类近期改进成果的3倍。在预训练数据筛选方面,优化后的流水线使平均基准性能提升+3.96点,在MMLU上最高提升超18点。在强化学习算法设计中,新发现的算法在AMC32上优于GRPO达+12.5点,在AIME24上+11.67点,在OlympiadBench上+5.04点。我们还初步验证了该范式可延伸至数学与生物医学领域。这些结果表明,ASI-Evolve为实现基础阶段的闭环AI研究提供了可行路径。

原文摘要 · Abstract (English)

Can AI accelerate the development of AI itself? While recent agentic systems have shown strong performance on well-scoped tasks with rapid feedback, it remains unclear whether they can tackle the costly, long-horizon, and weakly supervised research loops that drive real AI progress. We present ASI-Evolve, an agentic framework for AI-for-AI research that closes this loop through a learn-design-experiment-analyze cycle. ASI-Evolve augments standard evolutionary agents with two key components: a cognition base that injects accumulated human priors into each round of exploration, and a dedicated analyzer that distills complex experimental outcomes into reusable insights for future iterations. To our knowledge, ASI-Evolve is the first unified framework to demonstrate AI-driven discovery across three central components of AI development: data, architectures, and learning algorithms. In neural architecture design, it discovered 105 SOTA linear attention architectures, with the best discovered model surpassing DeltaNet by +0.97 points, nearly 3x the gain of recent human-designed improvements. In pretraining data curation, the evolved pipeline improves average benchmark performance by +3.96 points, with gains exceeding 18 points on MMLU. In reinforcement learning algorithm design, discovered algorithms outperform GRPO by up to +12.5 points on AMC32, +11.67 points on AIME24, and +5.04 points on OlympiadBench. We further provide initial evidence that this AI-for-AI paradigm can transfer beyond the AI stack through experiments in mathematics and biomedicine. Together, these results suggest that ASI-Evolve represents a promising step toward enabling AI to accelerate AI across the foundational stages of development, offering early evidence for the feasibility of closed-loop AI research.

AI自进化神经架构搜索自动机器学习闭环研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。