arXiv:2501.08149cs.AIcs.LG2025-01被引 3

针对异构数据的异常检测,提出多输入变分自编码器模型。

Multiple-Input Variational Auto-Encoder for Anomaly Detection in Heterogeneous Data

  • 用多个子编码器分别处理数据特征子集,通过重构误差评分
  • 在8个真实数据集上最高提升6% AUC性能,优于现有方法
  • 适合处理特征间差异大的异构数据,尤其适用于低异质性子集

异常检测在人工智能应用中至关重要,如分类与网络安全中的入侵检测。然而,现有方法面临非独立同分布(non-IID)数据带来的特征子集异构性挑战。本文提出一种新型神经网络模型——多输入自编码器异常检测(MIAEAD),为每个数据样本的特征子集分配异常分数,基于其子编码器的重构误差。所有子编码器通过无监督学习联合训练以确定异常分数。最终采用各子数据集上的最大AUC作为评估指标。为进一步利用生成模型对正常数据分布的建模能力来识别异常,提出多输入变分自编码器(MIVAE),通过子编码器处理特征子集后,在潜在空间学习正常数据分布,从而识别偏离该分布的异常。理论证明,所提MIVAE在正常样本与异常样本的平均异常分数差值上优于标准VAE,带来更高AUC。在8个真实世界异常检测数据集上的大量实验表明,MIAEAD和MIVAE相比传统方法及最先进无监督模型,最高提升6% AUC。此外,当应用于变异系数(CV)较低的特征子集时,模型表现尤为出色。

原文摘要 · Abstract (English)

Anomaly detection (AD) plays a pivotal role in AI applications, e.g., in classification, and intrusion/threat detection in cybersecurity. However, most existing methods face challenges of heterogeneity amongst feature subsets posed by non-independent and identically distributed (non-IID) data. We propose a novel neural network model called Multiple-Input Auto-Encoder for AD (MIAEAD) to address this. MIAEAD assigns an anomaly score to each feature subset of a data sample to indicate its likelihood of being an anomaly. This is done by using the reconstruction error of its sub-encoder as the anomaly score. All sub-encoders are then simultaneously trained using unsupervised learning to determine the anomaly scores of feature subsets. The final AUC of MIAEAD is calculated for each sub-dataset, and the maximum AUC obtained among the sub-datasets is selected. To leverage the modelling of the distribution of normal data to identify anomalies of the generative models, we develop a novel neural network architecture/model called Multiple-Input Variational Auto-Encoder (MIVAE). MIVAE can process feature subsets through its sub-encoders before learning distribution of normal data in the latent space. This allows MIVAE to identify anomalies that deviate from the learned distribution. We theoretically prove that the difference in the average anomaly score between normal samples and anomalies obtained by the proposed MIVAE is greater than that of the Variational Auto-Encoder (VAEAD), resulting in a higher AUC for MIVAE. Extensive experiments on eight real-world anomaly datasets demonstrate the superior performance of MIAEAD and MIVAE over conventional methods and the state-of-the-art unsupervised models, by up to 6% in terms of AUC score. Alternatively, MIAEAD and MIVAE have a high AUC when applied to feature subsets with low heterogeneity based on the coefficient of variation (CV) score.

异常检测变分自编码器异构数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。