arXiv:2504.04798cs.LG2025-04被引 10

用连续表示训练表格扩散模型,生成数据质量超原数据集。

TabRep: Training Tabular Diffusion Models with a Simple and Effective Continuous Representation

  • 采用统一连续表示替代离散编码,简化建模流程。
  • 在多个数据集上生成数据质量超越原始数据,且保持高效计算。
  • 适合需要高保真合成数据的隐私保护场景。

扩散模型已成为表格数据生成的主流方法,但面临离散与统一表示之间的权衡。分离表示需联合建模多模态分布,而统一表示虽缓解此问题,却依赖稀疏低效的编码策略并增加计算开销。本文提出TabRep,一种基于统一连续表示的表格扩散架构。通过几何分析揭示数据流形对扩散过程的影响,设计兼具密度、灵活性和关系保持能力的表示。实验表明,TabRep在多种评估中表现优异,首次实现生成数据在下游任务中性能超越原始数据,同时保障隐私且计算高效。代码已开源。

原文摘要 · Abstract (English)

Diffusion models have been the predominant generative model for tabular data generation. However, they face the conundrum of modeling under a separate versus a unified data representation. The former encounters the challenge of jointly modeling all multi-modal distributions of tabular data in one model. While the latter alleviates this by learning a single representation for all features, it currently leverages sparse suboptimal encoding heuristics and necessitates additional computation costs. In this work, we address the latter by presenting TabRep, a tabular diffusion architecture trained with a unified continuous representation. To motivate the design of our representation, we provide geometric insights into how the data manifold affects diffusion models. The key attributes of our representation are composed of its density, flexibility to provide ample separability for nominal features, and ability to preserve intrinsic relationships. Ultimately, TabRep provides a simple yet effective approach for training tabular diffusion models under a continuous data manifold. Our results showcase that TabRep achieves superior performance across a broad suite of evaluations. It is the first to synthesize tabular data that exceeds the downstream quality of the original datasets while preserving privacy and remaining computationally efficient. Code is available at https://github.com/jacobyhsi/TabRep.

表格生成扩散模型连续表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。