arXiv:2606.31270cs.CVcs.AI2026-06被引 1

让电脑操作智能体从失败中学习,提升任务成功率。

Learning from Failure: Inference-Time Self-Improvement for Computer-Use Agents

论文配图:Learning from Failure: Inference-Time Self-Improvement for Computer-Use Agents
图 1 · 摘自论文原文
  • 用大模型分析失败原因并生成修复代码,实现推理时自我改进。
  • 在OSWorld基准上成功率达48.9%,提升6.6个百分点。
  • 无需额外训练,仅需少量人工验证,适合实用型智能体优化。

计算机使用智能体利用多模态大语言模型操作计算机完成任务,备受关注。其主要挑战在于获取大规模高质量轨迹数据。现有方法通过自改进循环生成合成数据,仅利用成功轨迹,忽略失败轨迹中蕴含的模型弱点。本文提出一种以失败驱动的自改进机制,将失败轨迹转化为智能体改进资源。具体而言,采用大模型诊断失败模式、提出推理时解决方案并生成代码补丁,经少量人工轻度验证后用于升级智能体。在OSWorld基准上对当前最先进的OpenCUA-72B模型进行验证,成功率从42.3%提升至48.9%,提升6.6个百分点,且无需额外训练成本,仅带来适度推理开销。结果表明,失败驱动的自改进是成功导向流程的有效补充,可更高效地提升智能体性能。

原文摘要 · Abstract (English)

Computer-use agents, which leverage multimodal large language models (MLLMs) to operate computers and complete tasks, have attracted significant attention for their utility and versatility. A major challenge in developing these agents is collecting large-scale, high-quality trajectories. The standard approach generates synthetic data through a self-improving loop: an agent is placed in a verifiable environment and iteratively fine-tuned on its successful trajectories. Despite its effectiveness, this paradigm exploits only successful trajectories and discards the failed ones, even though failures carry rich information about a model's weaknesses. In this work, we explore a complementary failure-driven self-improvement loop, a data-centric paradigm that turns failed trajectories into agent improvements. Specifically, we employ an LLM to diagnose failure modes, propose inference-time solutions, and generate code patches -- lightly verified by humans -- that upgrade the agent. We validate this approach with the state-of-the-art OpenCUA-72B model on the OSWorld benchmark, improving the success rate from 42.3% to 48.9%, a gain of 6.6 percentage points, without any additional training cost and with only modest inference overhead. Our results demonstrate that failure-driven self-improvement is a viable complement to success-based pipelines, enabling more efficient agent improvement.

智能体失败学习自改进大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。