无需标签数据,用迁移学习精准识别多变量物联网异常流量。
A Transfer Learning Framework for Anomaly Detection in Multivariate IoT Traffic Data
- 基于无监督迁移学习,跨域利用无标签数据检测异常。
- 在全新入侵检测数据集上准确率超越现有方法。
- 适合缺乏标注数据的工业级物联网安全场景。
近年来,技术进步和互联网普及导致网络流量与时间序列数据中的异常显著增加。及时发现异常对保障服务质量、防止经济损失及维护安全标准至关重要。尽管机器学习算法在异常检测中表现出高精度,但其性能常受限于训练数据的具体条件。该领域长期面临时间序列数据中标注样本稀缺的问题,制约了传统机器学习与深度学习模型的训练效果。为此,无监督迁移学习成为可行方案,可通过源域的无标签数据识别目标域的异常。然而,多数现有方法仍需少量目标域标注数据。为克服此局限,本文提出一种面向多变量时间序列数据的异常检测迁移学习模型。不同于传统方法,本模型无需源域或目标域的标注数据。在新构建的入侵检测数据集上的实证评估表明,该模型能有效识别完全无标签的目标域异常,性能优于现有技术。
原文摘要 · Abstract (English)
In recent years, rapid technological advancements and expanded Internet access have led to a significant rise in anomalies within network traffic and time-series data. Prompt detection of these irregularities is crucial for ensuring service quality, preventing financial losses, and maintaining robust security standards. While machine learning algorithms have shown promise in achieving high accuracy for anomaly detection, their performance is often constrained by the specific conditions of their training data. A persistent challenge in this domain is the scarcity of labeled data for anomaly detection in time-series datasets. This limitation hampers the training efficacy of both traditional machine learning and advanced deep learning models. To address this, unsupervised transfer learning emerges as a viable solution, leveraging unlabeled data from a source domain to identify anomalies in an unlabeled target domain. However, many existing approaches still depend on a small amount of labeled data from the target domain. To overcome these constraints, we propose a transfer learning-based model for anomaly detection in multivariate time-series datasets. Unlike conventional methods, our approach does not require labeled data in either the source or target domains. Empirical evaluations on novel intrusion detection datasets demonstrate that our model outperforms existing techniques in accurately identifying anomalies within an entirely unlabeled target domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。