arXiv:2605.27276cs.AIcs.CL2026-05被引 7

让AI同时优化任务框架和模型权重,实现自我进化。

SIA: Self Improving AI with Harness & Weight Updates

论文配图:SIA: Self Improving AI with Harness & Weight Updates
图 1 · 摘自论文原文
  • 用语言模型同时改写任务框架和更新模型权重。
  • 在法律分类、代码优化和生物数据去噪上分别提升25.1%、12.4%和20.4%。
  • 适合想实现自主优化的AI系统研发人员。

人类是构建和改进AI的瓶颈,当前模型与代理均由人工编写、调优和修正。长期目标是实现能自我改进的AI。现有研究分为两派:一为'框架更新',由元代理在固定权重下重写任务代理的工具、提示、重试逻辑和搜索流程;另一为'测试时训练',通过人工设计的强化学习管道在固定框架下更新模型权重。二者长期割裂。本文提出SIA,一个可同时更新框架与权重的自改进循环:语言模型代理(Feedback-Agent)协同优化任务代理的架构与参数。在三个不同领域验证:中文法律定罪分类、低级GPU内核优化、单细胞RNA去噪。联合使用双重优化,在所有基准上均优于仅迭代框架的方法。SIA-W+H在LawBench上比前序最优高出25.1%,生成的GPU内核比前序最优快12.4%(1,017 vs 1,161 μs),在去噪任务上领先20.4%。框架更新赋予模型行动策略,权重更新则建立无法通过提示或结构传递的领域直觉。

原文摘要 · Abstract (English)

Humans are the bottleneck in building and improving AI. Both the models and the agents that wrap them are written, tuned, and corrected by people. The long-horizon goal of an AI that can figure out how to improve itself remains open. Two largely disjoint research lines attack this bottleneck. The harness-update school has a meta-agent rewrite the scaffold of a task-specific agent (its tools, prompts, retry logic, and search procedure) while the model weights are held fixed. The test-time training school uses hand-written RL pipelines to update the model's own weights on task feedback while the harness is held fixed. These two silos operate in isolation. We propose SIA, a self-improving loop in which a language-model agent (the Feedback-Agent) updates both the harness and the weights of a task-specific agent. We evaluate across three contrasting domains: Chinese legal charge classification, low-level GPU kernel optimisation, and single-cell RNA denoising. Combining both levers outperforms scaffold iteration alone on all three benchmarks. SIA-W+H achieves 25.1% over prior SOTA on LawBench, 12.4% faster GPU kernels than prior SOTA (1,017 vs 1,161 μs), and 20.4% over prior SOTA on denoising. Harness updates make the model agentic, shaping how it searches and acts, while weight updates build the domain intuition that no prompt or scaffold can instil.

自进化AI框架优化权重更新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。