arXiv:2605.06261cs.LGcs.AI2026-05被引 1

用推理时优化让合成表格数据媲美真实数据,无需重新训练。

Inference-Time Refinement Closes the Synthetic-Real Gap in Tabular Diffusion

论文配图:Inference-Time Refinement Closes the Synthetic-Real Gap in Tabular Diffusion
图 1 · 摘自论文原文
  • 在不修改预训练模型的前提下,通过评分引导优化生成结果。
  • 15个基准上平均提升12.9%,超过真实数据训练模型的性能。
  • 单张消费级显卡1-80分钟内完成,适合快速部署与隐私保护场景。

基于扩散模型的合成表格数据生成已达到当前最优水平,但其性能仍常低于真实数据。现有方法主要在训练阶段改进,而推理阶段的优化尚未被充分探索。本文提出TARDIS框架,对冻结的预训练模型进行推理时重构:通过树状帕尔岑估计器搜索得分级引导策略,在反向扩散过程中结合批量排序与软标签蒸馏,最小化合成与真实样本间的双向查姆费距离(BCR)。该模式在多数数据集上均被自动发现,且显著提升下游任务性能。在15个二分类、多分类及回归任务中,相比真实数据训练模型,中位提升达+8.6%(95%置信区间[+3.3, +16.4],威尔科克斯检验p=0.016,11/15严格胜出);在所有15个数据集上均优于原始TabDiff模型(平均+12.9%,p<10^-4),同时保持曼达福德保真度、多样性与样本级隐私。仅需单张消费级显卡1至80分钟即可完成优化。

原文摘要 · Abstract (English)

Diffusion-based generators set the current state of the art for synthetic tabular data. These methods approach but rarely exceed real-data utility, and closing this synthetic-real gap has so far been pursued exclusively at training time, via architectural advances, scaling, and retraining of monolithic generators. The inference-time alternative, i.e., refining the outputs of a pre-trained backbone with parameters left untouched, has remained largely unexplored for tabular synthesis. We introduce TARDIS (Tabular generation through Refinement, Distillation, and Inference-time Sampling), an inference-time refinement framework that operates on a frozen pre-trained backbone, configured per dataset by a Tree-structured Parzen Estimator search over score-level guidance during reverse diffusion, with each trial's objective set by an inner grid search over post-hoc sample selectors and an optional soft-label distillation step. The search space encodes a single mathematical pattern we name Bidirectional Chamfer Refinement (BCR): the symmetric Chamfer functional between synthetic and real samples is minimized both continuously, via a score-level gradient, and discretely, via batch-ranking post-generation. The per-dataset search recovers BCR-aligned configurations on most datasets, evidence for BCR as the dominant refinement pattern. Across 15 binary, multiclass, and regression benchmarks TARDIS achieves a median +8.6% downstream-task improvement over models trained on real data (95% CI [+3.3, +16.4], Wilcoxon p=0.016, 11/15 strict wins) and improves over the TabDiff backbone on all 15 datasets (mean +12.9%, p<10^-4), matching the backbone on manifold fidelity, diversity, and sample-level privacy. Inference-time refinement of a pre-trained tabular diffusion backbone reaches and exceeds real-data utility in 1 to 80 minutes on a single consumer-grade GPU.

表格生成扩散模型推理优化数据合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。