用图提示微调提升无线传感器网络异常检测性能
A Graph Prompt Fine-Tuning Method for WSN Spatio-Temporal Correlation Anomaly Detection
- 基于多尺度与跨模态融合改进Mamba,结合变分图卷积提取时空关联特征
- 自监督预训练+图提示微调,提升模型在无标注数据上的泛化能力
- 在真实与公开数据集上F1达92.31%,适合低标注成本场景
无线传感器网络(WSN)多时序模态数据的异常检测对保障网络可靠运行至关重要。现有方法存在时空相关性特征提取不足、异常样本标注成本高及类别不平衡等问题。本文针对WSN图结构数据特性,设计了融合时空相关性特征的图神经网络异常检测主干网络,并提出“预训练-图提示-微调”多任务自监督训练策略。首先,基于多尺度策略和跨模态融合改进Mamba模型,结合变分图卷积模块,在多节点、多时序场景下充分提取时空相关性特征。其次,设计包含无负样本对比学习、预测与重建三个子任务的自监督预训练方法,从无标签数据中学习通用特征;并引入“图提示-微调”机制,引导预训练模型完成参数微调,降低训练成本,增强检测泛化能力。在公开数据集与实际采集数据集上的实验显示,F1分数分别达到91.30%和92.31%,优于现有方法。
原文摘要 · Abstract (English)
Anomaly detection of multi-temporal modal data in Wireless Sensor Network (WSN) can provide an important guarantee for reliable network operation. Existing anomaly detection methods in multi-temporal modal data scenarios have the problems of insufficient extraction of spatio-temporal correlation features, high cost of anomaly sample category annotation, and imbalance of anomaly samples. In this paper, a graph neural network anomaly detection backbone network incorporating spatio-temporal correlation features and a multi-task self-supervised training strategy of "pre-training - graph prompting - fine-tuning" are designed for the characteristics of WSN graph structure data. First, the anomaly detection backbone network is designed by improving the Mamba model based on a multi-scale strategy and inter-modal fusion method, and combining it with a variational graph convolution module, which is capable of fully extracting spatio-temporal correlation features in the multi-node, multi-temporal modal scenarios of WSNs. Secondly, we design a three-subtask learning "pre-training" method with no-negative comparative learning, prediction, and reconstruction to learn generic features of WSN data samples from unlabeled data, and design a "graph prompting-fine-tuning" mechanism to guide the pre-trained self-supervised learning. The model is fine-tuned through the "graph prompting-fine-tuning" mechanism to guide the pre-trained self-supervised learning model to complete the parameter fine-tuning, thereby reducing the training cost and enhancing the detection generalization performance. The F1 metrics obtained from experiments on the public dataset and the actual collected dataset are up to 91.30% and 92.31%, respectively, which provides better detection performance and generalization ability than existing methods designed by the method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。