arXiv:2608.28790cs.MAcs.AI2026-08

ASTRA通过智能代理协作,让技术故障报告更可信、可追溯。

ASTRA - Agentic System for Ticket Resolution and Analysis

论文配图:ASTRA - Agentic System for Ticket Resolution and Analysis
图 1 · 摘自论文原文
  • 用三个专业代理分别查历史案例、日志和知识库,统一输出带证据来源的结论。
  • 在987个真实电信故障单上测试,报告质量达4.13/5,60%能准确定位到部件层级。
  • 适合需要高可信度诊断的运维团队,尤其对硬件故障仍存挑战。

技术运维团队处理大量故障时,需整合工单文本、历史案例、系统日志和技术文档中的碎片化信息。现有自动化方法多依赖单一生成模型,缺乏显式证据建模与溯源,当关键信号分散于多源时难以验证。本文提出ASTRA,一种用于工单诊断的智能体系统:中心协调器驱动三个专精信息采集代理,并通过判官-协调器迭代优化循环生成有证据支持的排障报告。TicketSimilarityAgent通过密集检索与大模型重排序获取相关历史案例;LogAgent使用确定性过滤与受限大模型分析,将数十万条日志提炼为结构化、引文锚定的发现;DomainKnowledgeAgent通过模型上下文协议(MCP)获取相关技术知识。三者输出转换为“主张-证据”结构,每条主张关联原始语句并标注支持等级,防止跨源误引。判官代理从五项指标评分,得分低则触发协调器生成针对性追问,实现有限迭代优化。在七条产品线共987个真实电信故障工单上评估,平均质量得分4.13/5.0,59.9%的报告可定位至组件族级或更细粒度。相关性与清晰度得分分别为4.88和4.94,虚构技术细节占比低于3%。按故障类型分层分析显示,硬件故障仍显著难于软件或配置故障(Cohen's d=0.80),揭示纯文本证据通道在硬件诊断中的根本局限。

原文摘要 · Abstract (English)

Technical operations teams resolve large volumes of incidents by synthesizing fragmented evidence from ticket text, historical cases, system logs, and technical documentation. Existing automation often relies on monolithic generation without explicit evidence modeling or provenance, making outputs difficult to verify when critical signals are sparse across sources. We propose ASTRA, an agentic system for ticket resolution in which a central orchestrator coordinates three specialist information-gathering agents and drives a judge-orchestrator refinement loop to produce evidence-backed troubleshooting reports. TicketSimilarityAgent retrieves relevant historical precedents through dense retrieval and LLM reranking; LogAgent distills hundreds of thousands of log lines into structured, quote-grounded findings using deterministic filtering and constrained LLM analysis; and DomainKnowledgeAgent retrieves relevant technical knowledge via the Model Context Protocol (MCP). Their outputs are transformed into a claim-evidence representation linking each claim to a verbatim source passage, assigning a support level, and preventing cross-attribution. A JudgeAgent scores the report on five criteria, while the OrchestratorAgent converts low scores into targeted follow-up queries for bounded iterative refinement. Evaluated on 987 real-world telecom fault tickets across seven product lines, ASTRA achieves a mean quality score of 4.13/5.0, with 59.9% of reports identifying the fault area at the component-family level or better. Relevance and Clarity scores are 4.88 and 4.94, respectively, while fabricated technical details remain below 3% of error cases. Stratification by fault type reveals that hardware faults remain substantially harder than software or configuration faults (Cohen's d=0.80), pointing to a fundamental limitation of text-based evidence channels for hardware fault diagnosis.

智能体系统故障诊断证据溯源运维自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。