用球坐标压缩潜在空间,提升异常检测能力
VAE with Hyperspherical Coordinates: Improving Anomaly Detection from Hypervolume-Compressed Latent Space
- 用球坐标重构潜在变量,聚焦关键方向
- 在火星车图像和星系图上异常检测更准
- 适合处理高维数据的异常检测任务
变分自编码器(VAE)将数据编码为低维潜在向量后解码。训练完成后,可检测分布外(异常)的潜在向量,但高维潜在空间存在超体积指数增长问题,严重限制生成能力。本文借鉴高维统计规律:标准VAE的潜在向量集中在超球面的赤道区域,不利于异常检测。为此,提出使用超球坐标表示潜在变量,将潜在向量向超球面某一方向压缩,从而获得更具表现力的近似后验分布。实验表明,该方法显著提升了无条件与条件下的异常检测性能,在所测试数据集上优于现有方法。具体包括:一、检测火星车相机中的异常地貌和地面影像中的异常星系(复杂真实数据集);二、以Cifar10及ImageNet子集作为分布内样本的标准基准测试。
原文摘要 · Abstract (English)
Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, one can hope to detect out-of-distribution (abnormal) latent vectors, but several issues arise when the latent space is high dimensional. This includes an exponential growth of the hypervolume with the dimension, which severely affects the generative capacity of the VAE. In this paper, we draw insights from high dimensional statistics: in these regimes, the latent vectors of a standard VAE are distributed on the `equators' of a hypersphere, challenging the detection of anomalies. We propose to formulate the latent variables of a VAE using hyperspherical coordinates, which allows compressing the latent vectors towards a given direction on the hypersphere, thereby allowing for a more expressive approximate posterior. We show that this improves both the fully unconditional-OOD and conditional-OOD anomaly detection ability of the VAE, achieving the best performance on the datasets we considered, outperforming existing methods. For the unconditional-OOD and conditional-OOD modalities, respectively, these are: i) detecting unusual landscape from the Mars Rover camera and unusual Galaxies from ground based imagery (complex, real world datasets); ii) standard benchmarks like Cifar10 and subsets of ImageNet as the in-distribution (ID) class.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。