arXiv:2508.02601cs.LGcs.AI2025-08

用依赖图当生成计划,让大模型按序生成表格数据。

StructSynth: Dependency Graphs as Generation Plans for Low-Data Tabular Synthesis with Language Models

  • 将依赖图作为生成顺序和条件的规划蓝图
  • 在少样本下生成数据质量优于14种现有方法
  • 适合需要高质量小样本表格数据的研究者

表格数据的价值源于特征间的依赖关系,但在样本稀缺时保持这些依赖关系极为困难。现有方法或通过分布拟合隐式学习依赖,或依赖统计图学习(样本少时不稳定),或通过扁平文本序列编码结构。近期图感知方法将依赖图用作注意力偏置或非大模型采样器的骨架,但未将其作为大模型生成过程的提示级计划。我们提出StructSynth,将依赖图视为生成计划——决定每个黑箱大模型调用的生成顺序、条件上下文和作用范围。在基于证据的图归纳中,大模型推理与统计关联线索共同从有限样本构建有向无环图(DAG)。在图规划的条件合成中,该DAG驱动按拓扑序的自回归生成,每个特征基于已生成值进行条件生成,且父节点结构明确指导每一步。实验表明,StructSynth在低数据设置下达到最优下游任务效用,并在14种对比生成器中隐私风险最低。

原文摘要 · Abstract (English)

Tabular data derives its value from inter-feature dependencies, yet preserving them during synthesis is fragile when samples are scarce. Existing approaches either learn dependencies implicitly through distribution fitting, rely on statistical graph learning that becomes unstable with few samples, or encode structure through flat text serialization. Recent graph-aware methods use dependency graphs as attention biases or as backbones for non-LLM samplers, but they do not use the graph as a prompt-level plan for organizing the LLM's own generation process. We introduce StructSynth, a framework that treats a dependency graph as a generation plan---determining the generation order, conditioning context, and scope of each black-box LLM call. In Evidence-Grounded Graph Induction, LLM reasoning and statistical association cues jointly construct a Directed Acyclic Graph (DAG) from limited samples. In Graph-Planned Conditional Synthesis, this DAG drives autoregressive synthesis in topological order, conditioning each feature on previously generated values with graph-specified parent structure guiding each step, making the conditioning schedule explicit throughout synthesis. Experiments show that StructSynth achieves state-of-the-art downstream utility and the best privacy-risk ranking among fourteen compared generators in low-data settings.

表格生成大模型依赖图低数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。