arXiv:2608.25661cs.SEcs.AI2026-08

用可自进化框架让大模型更准地找出系统故障根源

From General Agents to RCA Experts: A Self-Evolving Harness for Root Cause Analysis

论文配图:From General Agents to RCA Experts: A Self-Evolving Harness for Root Cause Analysis
图 1 · 摘自论文原文
  • 设计自演化框架,复用通用大模型能力并积累诊断经验
  • 在两个公开数据集和工业场景中达59%准确率,提升超6成
  • 适合需要持续优化的运维系统或想快速部署RCA的团队

基于大语言模型(LLM)的自动化根因分析(RCA)日益受到关注。当前运维工程师通常采用两种方式:直接使用通用代理(如Codex或Claude Code)进行诊断,或从零构建专用RCA代理。我们定量研究发现,前者如今常优于后者。然而其准确率仍难以满足生产需求,主要瓶颈在于代理外部的适配层,即‘Harness’。因此我们主张将重点放在该外部框架上,而非重造代理。核心能力是自演化——通过积累历史诊断经验不断优化。本文提出OpsHarness,将诊断经验转化为可复用的专业知识。其数据平面整合分层操作知识与工具卡库,控制平面负责配置、诊断、演化与验证。演化过程中,对比成功与失败轨迹,提取证据生成原子化建议,并通过双门验证机制防止过拟合与性能退化。在两个公开基准和一次工业部署中,该框架实现59.0%的top-1准确率,较裸露通用代理提升63.4%,较基线RCA代理提升4.02倍。

原文摘要 · Abstract (English)

Automated root cause analysis (RCA) with large language models (LLMs) has drawn growing attention. Today, SREs typically automate RCA with LLMs in one of two ways: directly using a general-purpose agent (e.g., Codex or Claude Code) for diagnosis, or building a specialized RCA agent from scratch. As mainstream general agents grow more capable and iterate quickly, our quantitative study finds that the former now often surpasses the latter. Its accuracy, however, still falls short of production needs, and this gap stems mainly from the external adaptation layer outside the agent's general capabilities, namely the harness. We therefore argue that LLM-based RCA should focus on this external harness, reusing the strong general capabilities of a modern agent rather than rebuilding an agent from scratch. A key capability of such a harness is to self-evolve, accumulating system-specific experience from past diagnoses so that it gets better the more it is used. We introduce OpsHarness, a self-evolving RCA harness that turns diagnosis experience into reusable expertise. Its data plane combines layered operational knowledge with an idea-card tool library, while its control plane coordinates setup, diagnosis, evolution, and verification. During evolution, OpsHarness contrasts successful and failed trajectories, converts their evidence into atomic proposals, and admits updates only through a dual-gate verification process designed to prevent overfitting and regression. Across two public benchmarks and an industrial deployment, OpsHarness achieves 59.0\% top-1 accuracy, improving over a bare general agent by 63.4\% and over baseline RCA agents by 4.02$\times$.

根因分析大模型应用自演化运维智能化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。