arXiv:2410.20626cs.LG2024-10ICLR被引 90

用统一扩散模型生成混合类型表格数据,提升真实性和相关性。

TabDiff: a Mixed-type Diffusion Model for Tabular Data Generation

  • 设计联合连续时间扩散过程,适配数值与分类变量分布差异。
  • 在7个数据集上8项指标均超越现有方法,相关性预测提升22.5%。
  • 适合需要高质量数据合成的隐私保护与数据增强场景。

高质表格数据合成在数据科学任务中至关重要,涵盖数据集扩充与隐私保护等应用。然而,由于表格数据具有异构类型、复杂列间相关性和复杂的列分布特性,构建表达能力强的生成模型仍具挑战。本文提出TabDiff,一种统一建模所有混合类型分布的扩散框架。核心创新在于为数值与分类数据设计特征级可学习的联合连续时间扩散过程,以应对不同特征分布的显著差异。模型采用Transformer处理多类型输入,支持端到端高效优化。此外,引入混合类型随机采样器自动修正采样过程中的累积误差,并提出无分类器引导机制用于条件缺失值补全。在7个数据集上的全面实验表明,TabDiff在全部8项评估指标上均优于现有基线模型,尤其在成对列相关性估计上相较当前最优模型提升最高达22.5%。代码已开源于https://github.com/MinkaiXu/TabDiff。

原文摘要 · Abstract (English)

Synthesizing high-quality tabular data is an important topic in many data science tasks, ranging from dataset augmentation to privacy protection. However, developing expressive generative models for tabular data is challenging due to its inherent heterogeneous data types, complex inter-correlations, and intricate column-wise distributions. In this paper, we introduce TabDiff, a joint diffusion framework that models all mixed-type distributions of tabular data in one model. Our key innovation is the development of a joint continuous-time diffusion process for numerical and categorical data, where we propose feature-wise learnable diffusion processes to counter the high disparity of different feature distributions. TabDiff is parameterized by a transformer handling different input types, and the entire framework can be efficiently optimized in an end-to-end fashion. We further introduce a mixed-type stochastic sampler to automatically correct the accumulated decoding error during sampling, and propose classifier-free guidance for conditional missing column value imputation. Comprehensive experiments on seven datasets demonstrate that TabDiff achieves superior average performance over existing competitive baselines across all eight metrics, with up to $22.5\%$ improvement over the state-of-the-art model on pair-wise column correlation estimations. Code is available at https://github.com/MinkaiXu/TabDiff.

表格生成扩散模型数据合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。