arXiv:2509.11950cs.LG2025-09中稿 · the Fourteenth Int…被引 9

提出新评估框架,无需真实因果结构也能衡量表格生成数据的结构保真度。

TabStruct: Measuring Structural Fidelity of Tabular Data

  • 引入全局效用指标,无需真实因果结构即可评估表格生成质量。
  • 在29个数据集上测试13种生成器,发现结构保真度与传统指标相关性弱。
  • 开源完整基准套件,适合表格生成模型开发者和评估者使用。

表格生成模型的评估仍具挑战性,因其异构数据特有的因果结构难以直观检验。现有工作虽引入结构保真度作为特定评估维度,但常忽略其与传统评估维度的协同关系,且多局限于小型数据集。因需真实因果结构才能量化保真度,而此类信息在真实数据中罕见。本文提出联合结构保真度与常规维度的新评估框架,引入新型指标“全局效用”,可在无真实因果结构条件下评估结构保真度。同时构建了名为TabStruct的综合性基准,涵盖来自9类生成器的13种模型,在29个数据集上进行大规模定量分析。结果表明,全局效用提供任务无关、领域无关的性能视角。我们开源了全套数据、评估流程及原始结果,代码见https://github.com/SilenceX12138/TabStruct。

原文摘要 · Abstract (English)

Evaluating tabular generators remains a challenging problem, as the unique causal structural prior of heterogeneous tabular data does not lend itself to intuitive human inspection. Recent work has introduced structural fidelity as a tabular-specific evaluation dimension to assess whether synthetic data complies with the causal structures of real data. However, existing benchmarks often neglect the interplay between structural fidelity and conventional evaluation dimensions, thus failing to provide a holistic understanding of model performance. Moreover, they are typically limited to toy datasets, as quantifying existing structural fidelity metrics requires access to ground-truth causal structures, which are rarely available for real-world datasets. In this paper, we propose a novel evaluation framework that jointly considers structural fidelity and conventional evaluation dimensions. We introduce a new evaluation metric, $\textbf{global utility}$, which enables the assessment of structural fidelity even in the absence of ground-truth causal structures. In addition, we present $\textbf{TabStruct}$, a comprehensive evaluation benchmark offering large-scale quantitative analysis on 13 tabular generators from nine distinct categories, across 29 datasets. Our results demonstrate that global utility provides a task-independent, domain-agnostic lens for tabular generator performance. We release the TabStruct benchmark suite, including all datasets, evaluation pipelines, and raw results. Code is available at https://github.com/SilenceX12138/TabStruct.

表格生成评估基准结构保真度全局效用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。