arXiv:2608.10157cs.AI2026-08

让智能体通过自我反馈优化规划能力,无需人工标注且更省算力。

SBCO: Self-Supervised, Verifier-Grounded Harness Optimization For Planning Agents

论文配图:SBCO: Self-Supervised, Verifier-Grounded Harness Optimization For Planning Agents
图 1 · 摘自论文原文
  • 基于自监督的分块坐标优化,用自身评分反馈改进策略
  • 在两个任务中性能媲美或超越定制化自修改模型,算力节省4-5.5倍
  • 适合需要持续优化但无法自参考的规划类任务,如自动化决策

自提升智能体旨在减少人工智能系统的人工工程成本,使其能够随时间自我演化与改进。近期提出的达尔文戈德尔机和赫克利戈德尔机等方法,通过自指机制实现无限递归的自我改进,但要求任务能力与自修改能力对齐——这仅在编码任务中成立。对于不满足该对齐条件的任务,现有方法需移除自指性或引入元智能体进行显式自修改,但计算开销巨大,依赖大量候选智能体的种群或搜索。针对具有明确约束的规划任务,本文提出一种更低成本的替代方案:SBCO(自监督块坐标优化器),属于与戈德尔机同源的闭环改进框架,但采用自监督而非自指。给定一个智能体框架,SBCO通过近似块坐标上升法,学习一组分解的验证器与框架策略,仅依靠自身生成的评分反馈来提升输出,全程无需人类标注且固定元智能体。在两个领域中,SBCO达到或超过定制化自修改基线性能,同时算力消耗仅为后者的1/4至1/5.5。

原文摘要 · Abstract (English)

Self-improving agents seek to reduce the human engineering effort behind AI systems by enabling them to evolve and self-improve their performance over time. Recently, methods like the Darwin Gödel Machine and the Huxley Gödel Machine have been proposed which enable open-ended, recursive self-improvement through self-reference where a coding agent edits its own code. Such self-referential self-improvement methods require that the competence required to perform the task coincides or aligns well with the competence required for self-modification which is the case for coding tasks. For domains or tasks, which do not satisfy the alignment needed, self-referential self-improvement is not available. In such cases, it is possible to adapt the above algorithms to other tasks by removing the self-referential aspect or introducing explicit self-modification of a meta-agent -- both computationally expensive, relying on population or self-modification search over many candidate agents. For planning tasks with explicit constraints, we propose a far cheaper alternative. We introduce SBCO (Self-supervised Block Coordinate Optimizer), a verifier-grounded harness optimizer in the same closed-loop, improve-from-experience family as the Gödel-machine methods, but self-supervised rather than self-referential. Given an agentic harness, SBCO learns a decomposed bank of verifiers and a harness policy via approximate block coordinate ascent, improving the agent's outputs from its own graded feedback---with a fixed meta-agent and no human labels. Across two domains SBCO matches or exceeds a customized self-modifying baseline while using 4-5.5 times less compute budget.

智能体优化自监督规划算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。