arXiv:2607.15524cs.LGcs.AI2026-07被引 9

用户自建框架通过迭代优化,用少量更新提升低算力模型性能。

Recursive Harness Self-Improvement

论文配图:Recursive Harness Self-Improvement
图 1 · 摘自论文原文
  • 将框架视为可迭代优化的提示模板,利用自身历史反馈改进
  • 30个任务中性能超越高算力模型,推理成本降低60%
  • 适合想低成本提升智能体表现的研究者与工程师

在模型-框架协同演化框架下,框架不仅是推理时的支撑结构,更是生成数据的组件,其执行轨迹可影响未来基础模型的训练。这推动了框架闭环学习:同时优化框架以提升当前智能体表现和未来模型训练所用轨迹质量。然而持续更新由提供方构建的框架成本高昂且费力。因此我们探究是否可通过任务特定方式优化用户构建的框架,在计算轻量、仅需少数迭代的情况下改善执行轨迹质量。为此,我们提出递归框架自提升(RHI),将框架表示为代理循环的提示级规范,并基于自身修订历史的成对反馈进行迭代优化。在涵盖量化金融、机器人和药学的30个合成机器学习任务中,仅几次RHI迭代即可显著提升低推理开销智能体的性能上限,超越对应高推理开销设置,同时推理成本降低高达60%。我们发现这些提升主要源于更高效的跨代理信息流动所带来的任务特异性上下文管理,而非更长的推理轨迹。最后,我们将这一行为形式化为信息论假说,指出RHI是模型-框架协同演化范式中持续学习的实用算法。

原文摘要 · Abstract (English)

Under model--harness co-evolution, harnesses are not merely inference-time scaffolds but data-generating components whose execution traces can shape future foundation models. This motivates harness-in-the-loop learning: optimizing harnesses for both immediate agent performance and the quality of traces used for future model training. However, continually updating provider-built scaffolds is costly and labor-intensive. We therefore investigate whether optimizing user-constructed harnesses in a task-specific manner can improve execution-trace quality while remaining computationally lightweight and requiring only a few update iterations. To this end, we introduce Recursive Harness Self-Improvement (RHI), which represents the harness as a prompt-level specification of the agent loop and iteratively refines it using pairwise feedback over its own revision history. Across 30 synthetic machine-learning research tasks spanning quantitative finance, robotics, and pharmacy, a few RHI iterations suffice to substantially raise the performance ceiling of low-reasoning-effort agents, exceeding the corresponding maximum-reasoning-effort setting while reducing inference cost by up to 60%. We show that these gains arise primarily from improved task-specific context management through more effective inter-agent information flow rather than longer reasoning traces. Finally, we formalize this behavior as an information-theoretic hypothesis for RHI's implicit optimization objective, suggesting RHI as a practical algorithm for continual learning within the paradigm of model--harness co-evolution.

框架优化持续学习智能体提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。