arXiv:2507.15839cs.LGcs.AI2025-07

用大模型生成可复用的采样脚本,高效低成本合成真实表格数据。

FASTGEN: Fast and Cost-Effective Synthetic Tabular Data Generation with LLMs

  • 大模型分析字段类型并生成分布脚本,替代逐条生成。
  • 合成数据在多样性和真实性上优于传统方法,效率提升显著。
  • 适合需大规模合成数据的工程测试与开发场景。

合成数据生成在真实数据因成本或稀缺性受限的场景中成为关键解决方案。大语言模型(LLMs)在多个领域展现出生成高质量、领域相关样本的卓越能力。然而,现有直接使用LLM逐条生成记录的方法,当需要大量合成数据时,带来难以承受的时间与成本开销。本文提出一种快速、低成本的表格数据合成方法,利用LLM将各字段的分布特征自动编码为可复用的采样脚本。通过自动识别字段为数值型、类别型或自由文本型,模型生成基于分布的脚本,无需持续调用大模型即可高效生成大规模、多样化且真实的合成数据集。实验表明,该方法在数据多样性和真实性上优于传统直接生成法,显著降低高容量合成数据的生成负担。我们计划将此方法应用于生产流水线的测试加速,以缩短开发周期并提升系统整体效率。我们的经验与洞见将为寻求可扩展、低成本合成数据方案的研究者与从业者提供支持。

原文摘要 · Abstract (English)

Synthetic data generation has emerged as an invaluable solution in scenarios where real-world data collection and usage are limited by cost and scarcity. Large language models (LLMs) have demonstrated remarkable capabilities in producing high-fidelity, domain-relevant samples across various fields. However, existing approaches that directly use LLMs to generate each record individually impose prohibitive time and cost burdens, particularly when large volumes of synthetic data are required. In this work, we propose a fast, cost-effective method for realistic tabular data synthesis that leverages LLMs to infer and encode each field's distribution into a reusable sampling script. By automatically classifying fields into numerical, categorical, or free-text types, the LLM generates distribution-based scripts that can efficiently produce diverse, realistic datasets at scale without continuous model inference. Experimental results show that our approach outperforms traditional direct methods in both diversity and data realism, substantially reducing the burden of high-volume synthetic data generation. We plan to apply this methodology to accelerate testing in production pipelines, thereby shortening development cycles and improving overall system efficiency. We believe our insights and lessons learned will aid researchers and practitioners seeking scalable, cost-effective solutions for synthetic data generation.

合成数据大模型表格生成高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。