arXiv:2603.01444cs.LG2026-03

无需展平即可生成带嵌套结构的稀疏数据,性能超越现有方法。

Autoregressive Synthesis of Sparse and Semi-Structured Mixed-Type Data

  • 将JSON记录序列化为键、值和结构标记,用路径编码位置。
  • 在18项对比中17项表现最佳,隐私得分均超96%。
  • 适合需要保留复杂结构的隐私数据生成场景。

合成数据生成对于隐私保护的数据共享、系统基准测试和测试数据提供至关重要。现有合成工具主要针对密集且固定模式的表格数据,但现代数据系统普遍存储和交换包含嵌套对象、可变长度数组和可选键的稀疏半结构化JSON。将表格合成器应用于此类数据需先展平记录为宽而稀疏的表,导致嵌套结构和数组被转化为列布局的伪影。我们提出ORiGAMi,一种无需展平即可建模和合成半结构化记录的自回归Transformer架构。ORiGAMi将JSON记录序列化为键、值和结构标记,并通过文档树中的路径编码标记位置。语法与模式约束确保生成JSON的语法正确性及数据集结构一致性。我们在六组数据集上评估ORiGAMi,涵盖从密集表格基准到大规模半结构化集合,对比了基于展平表示的VAE、GAN、扩散模型和自回归基线。在保真度、检测和实用性指标上,ORiGAMi在18项对比中取得17项最优,所有设置下隐私得分均高于96%。结果表明,原生记录建模是表格合成流水线的有力替代方案,在保持结构完整性的同时达到业界顶尖性能。

原文摘要 · Abstract (English)

Synthetic data generation is an important capability for privacy-preserving data sharing, system benchmarking and test data provisioning. For mixed-type data, existing synthesizers largely target dense, fixed-schema tables, but many modern data systems store and exchange sparse, semi-structured JSON with nested objects, variable-length arrays and optional keys. Applying tabular synthesizers to such data requires flattening records into wide, sparse tables, turning nested structure and arrays into column-layout artifacts. We present ORiGAMi, an autoregressive transformer architecture for modeling and synthesizing semi-structured records without flattening. ORiGAMi serializes JSON records into key, value, and structural tokens, and encodes token positions by their path in the document tree. Grammar and schema constraints enforce syntactically valid JSON and dataset-consistent structure. We evaluate ORiGAMi against VAE, GAN, diffusion, and autoregressive baselines that operate on flattened representations across six datasets ranging from dense tabular benchmarks to large-scale semi-structured collections. Across fidelity, detection, and utility metrics, ORiGAMi achieves the best score in 17 of 18 benchmark comparisons, while maintaining high privacy scores above 96% across all settings. These results establish native record modeling as a strong alternative to tabular synthesis pipelines, preserving structure while achieving state-of-the-art benchmark performance.

数据合成半结构化自回归隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。