用扩散模型生成欺诈数据,提升少数类识别效果
EmDT: Embedding Diffusion Transformer for Tabular Data Generation in Fraud Detection
- 先聚类发现欺诈模式,再用Transformer建模特征关系
- 在信用卡欺诈数据上,分类准确率显著优于现有方法
- 适合需要高质量合成数据的金融风控场景
不平衡数据给欺诈检测带来挑战,因分类器常偏向多数类,对罕见欺诈交易表现差。为此,本文提出聚类嵌入扩散-变压器(EmDT)模型,用于生成欺诈样本。核心创新在于利用UMAP聚类识别不同欺诈模式,并采用带正弦位置编码的Transformer去噪网络,在扩散过程中捕捉特征间关系。合成数据生成后,使用标准决策树类分类器(如XGBoost)进行分类,该类模型更适合表格数据。在信用卡欺诈检测数据集上的实验表明,与现有过采样和生成方法相比,EmDT显著提升下游分类性能,同时保持相近的隐私保护水平,并保留原始数据中的特征相关性。
原文摘要 · Abstract (English)
Imbalanced datasets pose a difficulty in fraud detection, as classifiers are often biased toward the majority class and perform poorly on rare fraudulent transactions. Synthetic data generation is therefore commonly used to mitigate this problem. In this work, we propose the Clustered Embedding Diffusion-Transformer (EmDT), a diffusion model designed to generate fraudulent samples. Our key innovation is to leverage UMAP clustering to identify distinct fraudulent patterns, and train a Transformer denoising network with sinusoidal positional embeddings to capture feature relationships throughout the diffusion process. Once the synthetic data has been generated, we employ a standard decision-tree-based classifier (e.g., XGBoost) for classification, as this type of model remains better suited to tabular datasets. Experiments on a credit card fraud detection dataset demonstrate that EmDT significantly improves downstream classification performance compared to existing oversampling and generative methods, while maintaining comparable privacy protection and preserving feature correlations present in the original data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。