arXiv:2509.20768cs.LGcs.AI2025-09被引 1

对比两种生成模型,找出生成表格数据时的最优配置。

Measuring LLM Sensitivity in Transformer-based Tabular Data Synthesis

  • 测试不同层数和隐藏层大小对生成质量与速度的影响。
  • 轻量级LLM在大数据集上保持高质量且更省资源。
  • 适合关注效率与数据质量平衡的研究者或开发者。

合成表格数据广泛应用于隐私保护的数据共享和数据驱动的模型开发。其效果高度依赖于所使用的表格数据生成(TDS)工具。近期研究表明,基于Transformer的模型在数据质量上优于生成对抗网络(GANs)和扩散模型等先进方法,但其高计算成本使得在普通硬件上难以部署。本研究针对超参数选择(如层数、隐藏维度)对合成数据质量及计算性能的影响进行敏感性评估。实验在GReaT和REaLTabFormer两个工具上展开,涵盖10种不同架构与深度的模型设置,基于四个真实世界数据集,在运行时间、机器学习效用和与真实数据分布的相似性三个维度进行评价。结果表明,运行时间随超参数数量增加而上升,浅层配置完成更快;GReaT整体运行时间低于REaLTabFormer,仅在最大数据集上两者相当。小数据集下两工具均实现高实用性和良好相似性,但在大数据集上仅REaLTabFormer能维持强效用与高相似性。因此,采用轻量级语言模型的REaLTabFormer在保证数据质量的同时显著降低计算开销,是当前最佳平衡方案。尽管如此,其运行时间仍高于GReaT及其他TDS工具,表明效率提升存在上限。

原文摘要 · Abstract (English)

Synthetic tabular data is used for privacy-preserving data sharing and data-driven model development. Its effectiveness, however, depends heavily on the used Tabular Data Synthesis (TDS) tool. Recent studies have shown that Transformer-based models outperform other state-of-the-art models such as Generative Adversarial Networks (GANs) and Diffusion models in terms of data quality. However, Transformer-based models also come with high computational costs, making them sometimes unfeasible for end users with prosumer hardware. This study presents a sensitivity assessment on how the choice of hyperparameters, such as number of layers or hidden dimension affects the quality of the resultant synthetic data and the computational performance. It is performed across two tools, GReaT and REaLTabFormer, evaluating 10 model setups that vary in architecture type and depth. We assess the sensitivity on three dimensions: runtime, machine learning (ML) utility, and similarity to real data distributions. Experiments were conducted on four real-world datasets. Our findings reveal that runtime is proportional to the number of hyperparameters, with shallower configurations completing faster. GReaT consistently achieves lower runtimes than REaLTabFormer, and only on the largest dataset they have comparable runtime. For small datasets, both tools achieve synthetic data with high utility and optimal similarity, but on larger datasets only REaLTabFormer sustains strong utility and similarity. As a result, REaLTabFormer with lightweight LLMs provides the best balance, since it preserves data quality while reducing computational requirements. Nonetheless, its runtime remains higher than that of GReaT and other TDS tools, suggesting that efficiency gains are possible but only up to a certain level.

表格生成Transformer效率优化数据合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。