arXiv:2412.11800cs.LGstat.ML2024-12被引 1

用二值告警数据高效发现大规模系统异常因果关系

Scalable Temporal Anomaly Causality Discovery in Large Systems: Achieving Computational Efficiency with Binary Anomaly Flag Data

  • 基于二值告警信号设计新型因果推断方法,适应稀疏数据特性
  • 在两个真实系统数据集上实现计算开销大幅降低,准确率适度提升
  • 适合需要实时诊断的大型监控系统,如高能物理或IT运维

异常因果关系提取有助于故障发生后的系统诊断。在大型系统中定位异常原因需跨多个子系统分析大量监控变量。然而,学习图形化因果模型(GCM)面临显著计算负担,限制了现有方法在实时和大规模部署中的应用。此外,现代大型系统监控常生成大量二值告警标志,其状态跃迁含义与数据稀疏性对现有因果学习机制构成挑战。本文提出一种异常因果发现方法(AnomalyCD),解决从时序二值标志数据构建GCM时的准确性与计算效率问题。AnomalyCD采用异常数据感知的因果检验、稀疏数据与先验连接压缩、边剪枝调整等策略。我们在两个数据集上验证该方法:一是欧洲核子研究中心(CERN)紧凑渺子线圈实验读出箱系统的传感器监控数据,二是公开的IT监控系统数据集。结果表明,所提方法在构建时序GCM时显著降低计算开销,同时在二值异常数据上实现适度精度提升。代码已开源:https://github.com/muleina/AnomalyCD。

原文摘要 · Abstract (English)

Extracting anomaly causality facilitates diagnostics once monitoring systems detect system faults. Identifying anomaly causes in large systems involves investigating a broader set of monitoring variables across multiple subsystems. However, learning graphical causal models (GCMs) comes with a significant computational burden that restrains the applicability of most existing methods in real-time and large-scale deployments. In addition, modern monitoring applications for large systems often generate large amounts of binary alarm flags, and the distinct characteristics of binary anomaly data -- the meaning of state transition and data sparsity -- challenge existing causality learning mechanisms. This study proposes an anomaly causal discovery approach (AnomalyCD), addressing the accuracy and computational challenges of generating GCMs from temporal binary flag datasets. The AnomalyCD presents several strategies, such as anomaly data-aware causality testing, sparse data and prior link compression, and edge pruning adjustment approaches. We validate the performance of the approach on two datasets: monitoring sensor data from the readout-box system of the Compact Muon Solenoid experiment at CERN, and a public dataset from an information technology monitoring system. The results on temporal GCMs demonstrate a considerable reduction of computation overhead and a moderate enhancement of accuracy on the binary anomaly datasets. Code: https://github.com/muleina/AnomalyCD .

异常检测因果推理监控系统二值数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。