提出隐私保护合成数据的评估框架,揭示真实场景下性能显著下降。
Generating Synthetic Data with Formal Privacy Guarantees: State of the Art and the Road Ahead
- 构建理论与实践结合的合成数据评估框架
- 实测显示ε≤4时性能大幅下降,真实场景表现远差于通用基准
- 适合关注数据隐私合规与真实应用落地的研究者
隐私保护合成数据为高风险领域中因监管、隐私或机构限制而隔离的数据利用提供了有前景的解决方案。本综述系统梳理了生成模型与差分隐私的理论基础,回顾了表格数据、图像和文本领域的前沿方法。通过分析四种主流方法在五个专业领域真实数据集上的表现,揭示了下游任务效用与隐私保证之间存在根本性权衡。在真实隐私约束(ε≤4)下,性能显著退化,暴露出当前研究在专用领域缺乏真实基准、实证验证不足等问题。研究指出,需建立更稳健的评估体系、标准化专业领域基准,并改进满足敏感领域需求的技术,以实现该技术的巨大潜力。
原文摘要 · Abstract (English)
Privacy-preserving synthetic data offers a promising solution to harness segregated data in high-stakes domains where information is compartmentalized for regulatory, privacy, or institutional reasons. This survey provides a comprehensive framework for understanding the landscape of privacy-preserving synthetic data, presenting the theoretical foundations of generative models and differential privacy followed by a review of state-of-the-art methods across tabular data, images, and text. Our synthesis of evaluation approaches highlights the fundamental trade-off between utility for down-stream tasks and privacy guarantees, while identifying critical research gaps: the lack of realistic benchmarks representing specialized domains and insufficient empirical evaluations required to contextualise formal guarantees. Through empirical analysis of four leading methods on five real-world datasets from specialized domains, we demonstrate significant performance degradation under realistic privacy constraints ($ε\leq 4$), revealing a substantial gap between results reported on general domain benchmarks and performance on domain-specific data. %Our findings highlight key challenges including unaccounted privacy leakage, insufficient empirical verification of formal guarantees, and a critical deficit of realistic benchmarks. These challenges underscore the need for robust evaluation frameworks, standardized benchmarks for specialized domains, and improved techniques to address the unique requirements of privacy-sensitive fields such that this technology can deliver on its considerable potential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。