arXiv:2602.17037cs.SEcs.AI2026-02被引 12

让编程智能体自动纠错,减少90%的错误干预

Wink: Recovering from Misbehaviors in Coding Agents

  • 通过分析真实流量构建错误分类,识别三类主要问题
  • 部署轻量异步系统Wink,90%错误仅需一次干预即可修复
  • 适合希望降低人工介入、提升智能体稳定性的工程团队

自主编程智能体依赖大语言模型在软件行业广泛应用,但易出现偏离指令、陷入循环或工具调用失败等行为问题,导致开发流程中断并需大量人工干预。本文提出一种可规模化自动恢复智能体异常行为的系统Wink。基于对生产流量的分析,我们定义了三类主要错误:需求漂移、推理问题和工具调用失败,占所有智能体轨迹的约30%。Wink作为轻量级异步自我干预系统,实时观察智能体行为轨迹,提供精准纠偏指引,使其重回有效路径。在超过10,000条真实智能体轨迹上评估,系统可成功解决90%需单次干预的错误。此外,在生产环境中开展的实时A/B测试显示,该系统显著降低了工具调用失败率、每会话令牌消耗及工程师干预次数。本文分享了系统设计与部署经验,为构建可扩展的鲁棒智能体系统提供了关键洞见。

原文摘要 · Abstract (English)

Autonomous coding agents, powered by large language models (LLMs), are increasingly being adopted in the software industry to automate complex engineering tasks. However, these agents are prone to a wide range of misbehaviors, such as deviating from the user's instructions, getting stuck in repetitive loops, or failing to use tools correctly. These failures disrupt the development workflow and often require resource-intensive manual intervention. In this paper, we present a system for automatically recovering from agentic misbehaviors at scale. We first introduce a taxonomy of misbehaviors grounded in an analysis of production traffic, identifying three primary categories: Specification Drift, Reasoning Problems, and Tool Call Failures, which we find occur in about 30% of all agent trajectories. To address these issues, we developed a lightweight, asynchronous self-intervention system named Wink. Wink observes agent trajectories and provides targeted course-correction guidance to nudge the agent back to a productive path. We evaluated our system on over 10,000 real world agent trajectories and found that it successfully resolves 90% of the misbehaviors that require a single intervention. Furthermore, a live A/B test in our production environment demonstrated that our system leads to a statistically significant reduction in Tool Call Failures, Tokens per Session and Engineer Interventions per Session. We present our experience designing and deploying this system, offering insights into the challenges of building resilient agentic systems at scale.

智能体错误恢复大模型应用自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。