arXiv:2512.18199cs.CRcs.AI2025-12

让入侵检测系统决策可解释,提升安全分析师信任度

PROVEX: Enhancing SOC Analyst Trust with Explainable Provenance-Based IDS

  • 在时序图检测系统上添加事后解释,定位关键异常子图
  • 解释平均耗时3-5秒,准确识别恶意文件操作和异常网络流量
  • 适合关注AI可解释性的安全团队与红蓝对抗人员

现代入侵检测系统(IDS)利用图神经网络(GNN)分析系统溯源数据以发现恶意行为,但其决策过程对分析师而言仍是黑箱。本文提出一个完整的可解释人工智能(XAI)框架,旨在通过增强基于图的检测透明性来弥合安全运营中心(SOC)中的信任差距。该框架在领先的时间图检测系统KAIROS基础上实现,设计适用于任何时间图检测器,仅需少量适配。我们集成三种GNN解释方法——GraphMask、GNNExplainer和变分时序图解释器(VA-TGExplainer),用于生成人类可理解的异常行为表示,包括关键边和不确定性估计。重点解决内存管理与可复现性挑战。在DARPA CADETS Engagement 3数据集上的实验表明,该框架能生成简洁的窗口级解释,准确揭示攻击中的关键因果边,如恶意文件交互和异常网络流,解释保留原模型决策的高保真度,平均每个事件解释耗时3-5秒。通过揭示模型推理逻辑,本框架有望提升分析师信任与响应效率。

原文摘要 · Abstract (English)

Modern intrusion detection systems (IDS) leverage graph neural networks (GNNs) to detect malicious activity in system provenance data, but their decisions often remain a black box to analysts. This paper presents a comprehensive XAI framework designed to bridge the trust gap in Security Operations Centers (SOCs) by making graph-based detection transparent. We implement this framework on top of KAIROS, a state-of-the-art temporal graph-based IDS, though our design is applicable to any temporal graph-based detector with minimal adaptation. The complete codebase is available at https://github.com/devang1304/provex.git. We augment the detection pipeline with post-hoc explanations that highlight why an alert was triggered, identifying key causal subgraphs and events. We adapt three GNN explanation methods - GraphMask, GNNExplainer, and a variational temporal GNN explainer (VA-TGExplainer) - to the temporal provenance context. These tools output human-interpretable representations of anomalous behavior, including important edges and uncertainty estimates. Our contributions focus on the practical integration of these explainers, addressing challenges in memory management and reproducibility. We demonstrate our framework on the DARPA CADETS Engagement 3 dataset and show that it produces concise window-level explanations for detected attacks. Our evaluation reveals that the explainers preserve the TGNN's decisions with high fidelity, surfacing critical edges such as malicious file interactions and anomalous netflows. The average explanation overhead is 3-5 seconds per event. By providing insight into the model's reasoning, our framework aims to improve analyst trust and triage speed.

可解释AI入侵检测图神经网络安全运营

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。