arXiv:2609.06396cs.LG2026-09

构建可自我迭代的科研系统,让模型在真实科学问题中持续进化。

MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves

论文配图:MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves
图 1 · 摘自论文原文
  • 用三类操作符组合式改进模型、数据与结构,不依赖外部教师。
  • 在代码与封闭形式科学任务上实现闭环自进化,无需人工干预。
  • 适合研究通用人工智能、自动化科研与模型持续优化的学者。

递归自我改进(RSI)使系统能从自身失败中优化建模机制,使后续模型继承改进成果。然而,现有验证几乎仅限于编码和形式化基准(如科学问答、数学题)。这种限制将RSI局限于可机器验证的范畴,无法覆盖开放性科学问题中依赖论证、复现或测量判断正确性的领域。本文主张RSI应扩展至真实、多样的科学、工程与元科学领域。为此提出MetaRSI-v1,通过统一范式下三种类型算子的调度组合实现改进:数据-RSI增强现有能力并标记边界;利用-RSI在不修改权重的前提下编辑五槽框架;模型-RSI通过有界训练将能力内化为参数。三者共享同一循环内核与产物词汇表,使数据、结构与模型变更可组合而非互斥。双轴优化器联合决定算子顺序与每一步的提议策略,元策略则跨周期调整整体调度。在标准评估下,仅以目标模型自身完成所有角色,验证了其在代码与闭合形式科学任务上的有效性。该框架将自改进从单一表面修改重构为全模型生产流程的组合,开辟两条路径:模型路径通过训练内化能力,框架路径保持权重不变,使自改进适用于任何可通过接口访问的模型,同时将数据-RSI重新定义为二者共享的基础输入。该框架进一步导出可检验的规律,揭示循环存在的条件、算子组合方式及监督的边际收益。

原文摘要 · Abstract (English)

Recursive self-improvement (RSI) lets a system improve the model-building machinery from its own failures, so every later model inherits the gain. Yet RSI has been validated almost exclusively on coding and formal benchmarks such as science QA and mathematics. This format bound limits RSI to improvement within a machine-checkable slice, not general capability where questions are open and correctness is settled by argument, replication, or measurement. We argue RSI must next operate across real, diverse scientific, engineering, and meta-scientific domains, not where formal evaluation is merely tractable. To that end we present MetaRSI-v1, where improvement is the scheduled composition of three typed operators over one unified paradigm. Data-RSI amplifies existing competence and marks its boundary; Harness-RSI edits a five-slot scaffold without touching weights; Model-RSI internalizes capability into parameters through bounded training. Sharing one loop kernel and artifact vocabulary, they make data, scaffold, and model changes composable rather than exclusive. A two-axis optimizer jointly decides operator order and each operator's proposal policy, while a meta-level policy revises the schedule across terms. We validate MetaRSI-v1 under the field's standard evaluations, on code and closed-form science, with no external teacher: the target model plays every role in its own loop. MetaRSI-v1 reframes self-improvement from a single-surface edit to a composition across the full model-production pipeline, opening two paths: a model route internalizing capability through training, and a harness route leaving weights untouched and thus extending self-improvement to any model reachable through an interface, with Data-RSI redefined as the shared substrate feeding both. The framework further yields refutable laws on where loops exist, how operators compose, and what supervision buys.

自进化模型迭代科研自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。