用图频域分析实时检测主机日志中的异常攻击,准确率超98%。
LogSHIELD: A Graph-based Real-time Anomaly Detection Framework using Frequency Analysis
- 构建日志溯源图并进行频域分析,挖掘行为间的因果关系。
- 在77400万正常日志和37.5万恶意日志上实现98%以上AUC与F1值。
- 检测延迟仅0.13秒,适合大规模企业网络实时防御场景。
基于深度学习的异常检测在新型网络攻击识别与取证中日益流行。大型企业网络所需的高效、实时威胁检测需兼顾高精度、高保真和高吞吐量。传统方法因计算开销大、准确率低,难以满足实时需求。本文提出LogSHIELD,一种基于图结构的实时异常检测框架,利用溯源图的频域分析实现威胁检测。提出两种方法:方法一采用图神经网络LogGNN;方法二对图节点样本进行频域分析以生成嵌入表示。两者均结合统计聚类算法完成异常检测。模型在包含7.74亿条良性日志与37.5万条恶意日志的大规模主机日志数据集上评估,可有效揭示隐蔽复杂攻击,平均AUC与F1得分超98%,检测延迟平均仅0.13秒,显著优于当前最优模型。
原文摘要 · Abstract (English)
Anomaly-based cyber threat detection using deep learning is on a constant growth in popularity for novel cyber-attack detection and forensics. A robust, efficient, and real-time threat detector in a large-scale operational enterprise network requires high accuracy, high fidelity, and a high throughput model to detect malicious activities. Traditional anomaly-based detection models, however, suffer from high computational overhead and low detection accuracy, making them unsuitable for real-time threat detection. In this work, we propose LogSHIELD, a highly effective graph-based anomaly detection model in host data. We present a real-time threat detection approach using frequency-domain analysis of provenance graphs. To demonstrate the significance of graph-based frequency analysis we proposed two approaches. Approach-I uses a Graph Neural Network (GNN) LogGNN and approach-II performs frequency domain analysis on graph node samples for graph embedding. Both approaches use a statistical clustering algorithm for anomaly detection. The proposed models are evaluated using a large host log dataset consisting of 774M benign logs and 375K malware logs. LogSHIELD explores the provenance graph to extract contextual and causal relationships among logs, exposing abnormal activities. It can detect stealthy and sophisticated attacks with over 98% average AUC and F1 scores. It significantly improves throughput, achieves an average detection latency of 0.13 seconds, and outperforms state-of-the-art models in detection time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。