为生产环境AI诊断构建因果智能层,显著提升故障定位效率与准确性。
Causely: A Causal Intelligence Layer for Enterprise AI A Benchmark Study on SRE and Reliability Workflows
- 构建基于因果关系的环境知识库,替代原始日志直接推理。
- 故障场景下诊断时间减少63%,工具调用次数降低78%。
- 适合SRE团队和需要高可靠性的企业AI系统开发者。
当前部署于SRE工作流中的AI代理依赖实时原始可观测性数据理解环境状态,导致查询时产生高昂的语义解析成本(令牌消耗、延迟与推理可靠性下降)。本文提出Causely——一种因果智能层,通过维护结构化环境拓扑、属性依赖及因果关系,并锚定在受管环境的本体表示上,将原始遥测数据转化为可实时查询的语义化、因果化模型。该模型为AI代理提供诊断、影响评估与安全决策所需的因果基础。我们在一个包含24个微服务的OpenTelemetry演示应用中开展基准测试,通过注入故障控制实验环境。对比四种代理配置(Claude Code、OpenAI Codex、HolmesGPT with Sonnet和Gemini后端),在故障活跃与健康基线两种场景下评估有无Causely的效果。结果表明:在故障场景中,因果支持使平均诊断时间缩短63%,平均令牌消耗减少60%,平均工具调用次数下降78%,调查足迹压缩4.8倍,每轮直接API成本降低57%;根因诊断准确率从75%提升至100%。
原文摘要 · Abstract (English)
AI agents deployed into SRE workflows currently derive their understanding of environment state from raw observability telemetry at query time, paying a semantic-interpretation tax in tokens, latency, and inferential reliability. We propose Causely, a causal intelligence layer that maintains a structured representation of environment topology, attribute dependencies, and causal relationships that are anchroed to a ontological representation of the managed environment. Causely transforms raw telemetry into a live, queryable model providing the semantic and causal foundation AI agents require to diagnose, evaluate impact, and act safely in production. We evaluate this value proposition through a benchmark study conducted in a controlled setting with injected faults in a 24-microservice OpenTelemetry demo application. Our experiments compare four agent configurations (Claude Code, OpenAI Codex, HolmesGPT with Sonnet and Gemini backends). Experiments are run with and without access to Causely under two scenarios: an active incident and a healthy baseline. On the active-fault scenario, causal grounding reduces mean time-to-diagnosis by 63\%, mean token consumption by 60\%, and mean tool-call count by 78\%, compressing the investigation footprint by 4.8$\times$ and lowering direct API cost per run by 57\%; root-cause-diagnosis accuracy rises from 75\% to 100\%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。