arXiv:2603.19461cs.AI2026-03被引 21

让AI不仅能解决问题,还能不断改进自己解决问题的方法。

Hyperagents

  • 将任务与元认知能力整合为可编辑的统一程序,实现自我优化的闭环。
  • 在多个任务中持续提升性能,超越无自进化能力的基线系统。
  • 能自动改进自身生成新智能体的机制,跨任务积累优化成果。

自改进型AI系统旨在减少对人工设计的依赖,通过学习提升自身的学习与求解能力。现有方法依赖固定的手工设计元机制,限制了改进速度。达尔文-哥德尔机器(DGM)通过反复生成和评估自修改版本,在编码任务中实现开放式的自改进。由于评估与自修改均为编码任务,编码能力的提升可转化为自改进能力的提升。但这种对齐仅限于编码领域。本文提出超智能体(hyperagents),将任务代理(解决目标任务)与元代理(修改自身及任务代理)融合为单一可编辑程序。关键在于,元级修改过程本身也可被编辑,支持元认知自修改,不仅提升任务表现,也优化未来改进机制。我们通过扩展DGM构建了DGM-超智能体(DGM-H),消除了任务性能与自修改技能之间的领域特定对齐假设,有望在任意可计算任务上实现自加速进步。在多样任务中,DGM-H持续提升性能,优于无自改进或开放探索的基线,以及先前的自改进系统。此外,其改进自身生成新代理的过程(如持久记忆、性能追踪),且这些元级改进可跨领域迁移并跨运行累积。DGM-超智能体展现了不只搜索更好解,而是持续改进如何改进的开放式人工智能系统雏形。

原文摘要 · Abstract (English)

Self-improving AI systems aim to reduce reliance on human engineering by learning to improve their own learning and problem-solving processes. Existing approaches to self-improvement rely on fixed, handcrafted meta-level mechanisms, fundamentally limiting how fast such systems can improve. The Darwin Gödel Machine (DGM) demonstrates open-ended self-improvement in coding by repeatedly generating and evaluating self-modified variants. Because both evaluation and self-modification are coding tasks, gains in coding ability can translate into gains in self-improvement ability. However, this alignment does not generally hold beyond coding domains. We introduce \textbf{hyperagents}, self-referential agents that integrate a task agent (which solves the target task) and a meta agent (which modifies itself and the task agent) into a single editable program. Crucially, the meta-level modification procedure is itself editable, enabling metacognitive self-modification, improving not only the task-solving behavior, but also the mechanism that generates future improvements. We instantiate this framework by extending DGM to create DGM-Hyperagents (DGM-H), eliminating the assumption of domain-specific alignment between task performance and self-modification skill to potentially support self-accelerating progress on any computable task. Across diverse domains, the DGM-H improves performance over time and outperforms baselines without self-improvement or open-ended exploration, as well as prior self-improving systems. Furthermore, the DGM-H improves the process by which it generates new agents (e.g., persistent memory, performance tracking), and these meta-level improvements transfer across domains and accumulate across runs. DGM-Hyperagents offer a glimpse of open-ended AI systems that do not merely search for better solutions, but continually improve their search for how to improve.

自改进元认知开放进化智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。