TAEGAN用自编码器生成表格数据,提升隐私保护与数据增强效果。
TAEGAN: Generating Synthetic Tabular Data For Data Augmentation
- 用掩码自编码器做生成器,结合自监督预训练提升稳定性。
- 在8个数据集上5个超越基线,整体效用提升27%,模型体积小于1/20。
- 适合处理不平衡数据,对小模型高效生成真实分布数据。
合成表格数据生成在数据增强和隐私保护数据共享中备受关注。尽管扩散模型和自回归模型(如Transformer)取得进展,生成对抗网络(GAN)仍因训练效率高、生成能力强而保持竞争力。本文提出一种基于GAN的新框架——表格式自编码器生成对抗网络(TAEGAN),其生成器采用掩码自编码器结构。TAEGAN首次将生成器的自监督预训练引入表格GAN,增强了模型稳定性,并使生成器获得超出判别器反馈的更丰富信息。此外,我们设计了针对不平衡或偏斜数据的新型采样方法,以及改进的损失函数,以更好捕捉数据分布与相关性。我们在8个数据集上对比了7种先进合成表格数据生成算法,结果表明,TAEGAN在5个数据集上超越所有基线,在整体性能上相比最优基线提升27%的同时,模型规模不足其5%。代码已公开:https://github.com/BetterdataLabs/taegan。
原文摘要 · Abstract (English)
Synthetic tabular data generation has gained significant attention for its potential in data augmentation and privacy-preserving data sharing. While recent methods like diffusion and auto-regressive models (i.e., transformer) have advanced the field, generative adversarial networks (GANs) remain highly competitive due to their training efficiency and strong data generation capabilities. In this paper, we introduce Tabular Auto-Encoder Generative Adversarial Network (TAEGAN), a novel GAN-based framework that leverages a masked auto-encoder as the generator. TAEGAN is the first to incorporate self-supervised warmup training of generator into tabular GANs. It enhances GAN stability and exposes the generator to richer information beyond the discriminator's feedback. Additionally, we propose a novel sampling method tailored for imbalanced or skewed data and an improved loss function to better capture data distribution and correlations. We evaluate TAEGAN against seven state-of-the-art synthetic tabular data generation algorithms. Results from eight datasets show that TAEGAN outperforms all baselines on five datasets, achieving a 27% overall utility boost over the best-performing baseline while maintaining a model size less than 5% of the best-performing baseline model. Code is available at: https://github.com/BetterdataLabs/taegan.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。