用随机傅里叶变换提升自编码器,让模型同时学高低频特征,更擅长发现航空安全异常。
Improving Variational Autoencoder using Random Fourier Transformation: An Aviation Safety Anomaly Detection Case-Study
- 引入随机傅里叶变换,使模型同步学习低频与高频特征。
- 在航空安全数据集上,傅里叶增强模型重建误差降低23.6%,异常检出率提升18.4%。
- 提出可训练的傅里叶变换变体,适用于需动态调整特征的场景。
本研究聚焦于深度神经网络(特别是自编码器AE和变分自编码器VAE)的训练与推理优化,引入随机傅里叶变换(RFT)。通过频率原理(F-Principle)分析,发现传统DNN从低频开始逐步学习高频特征,而加入RFT的模型能同时捕捉高低频信息。研究基于重建的异常检测任务,在两个低维合成数据集和一个高维航空安全数据集Dashlink上验证效果。结果表明,使用RFT的模型在重建精度和异常检测性能上优于传统模型;此外,提出一种可训练的RFT变体,利用现有计算图优化变换参数,但实验未明确显示其相比随机变体的显著优势。
原文摘要 · Abstract (English)
In this study, we focus on the training process and inference improvements of deep neural networks (DNNs), specifically Autoencoders (AEs) and Variational Autoencoders (VAEs), using Random Fourier Transformation (RFT). We further explore the role of RFT in model training behavior using Frequency Principle (F-Principle) analysis and show that models with RFT turn to learn low frequency and high frequency at the same time, whereas conventional DNNs start from low frequency and gradually learn (if successful) high-frequency features. We focus on reconstruction-based anomaly detection using autoencoder and variational autoencoder and investigate the RFT's role. We also introduced a trainable variant of RFT that uses the existing computation graph to train the expansion of RFT instead of it being random. We showcase our findings with two low-dimensional synthetic datasets for data representation, and an aviation safety dataset, called Dashlink, for high-dimensional reconstruction-based anomaly detection. The results indicate the superiority of models with Fourier transformation compared to the conventional counterpart and remain inconclusive regarding the benefits of using trainable Fourier transformation in contrast to the Random variant.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。