提出两阶段合成数据方法,平衡隐私与预测性能。
Two-Stage Data Synthesization: A Statistics-Driven Restricted Trade-off between Privacy and Prediction
- 先生成合成数据再混合原始数据,提升统计特性保留。
- 用核岭回归生成输出,实现隐私与预测的可控权衡。
- 理论与实证结合,适用于营销等真实场景。
合成数据在多个领域受到关注,尤其强调其在下游预测任务中的表现。然而,现有合成策略多聚焦于保持统计信息,虽有研究提供预测性能保证,但单阶段设计难以兼顾高隐私要求(需强扰动)与预测性能(对扰动敏感)之间的矛盾。本文提出两阶段合成策略:第一阶段采用‘合成-混合’策略,先生成纯合成数据,再与原始数据融合;第二阶段基于核岭回归(KRR)建模,先在原始数据上训练KRR模型,再以第一阶段生成的合成输入为条件生成合成输出。利用KRR的理论优势及第一阶段保持的协变分布特性,该方法实现统计驱动的受限隐私-预测权衡,并可保证最优预测性能。我们在理论上和数值上验证了该方法的有效性,展示了其在隐私-预测权衡上的可控性与通用性,进一步通过营销问题及五个真实数据集的应用证明其适用性。
原文摘要 · Abstract (English)
Synthetic data have gained increasing attention across various domains, with a growing emphasis on their performance in downstream prediction tasks. However, most existing synthesis strategies focus on maintaining statistical information. Although some studies address prediction performance guarantees, their single-stage synthesis designs make it challenging to balance the privacy requirements that necessitate significant perturbations and the prediction performance that is sensitive to such perturbations. We propose a two-stage synthesis strategy. In the first stage, we introduce a synthesis-then-hybrid strategy, which involves a synthesis operation to generate pure synthetic data, followed by a hybrid operation that fuses the synthetic data with the original data. In the second stage, we present a kernel ridge regression (KRR)-based synthesis strategy, where a KRR model is first trained on the original data and then used to generate synthetic outputs based on the synthetic inputs produced in the first stage. By leveraging the theoretical strengths of KRR and the covariant distribution retention achieved in the first stage, our proposed two-stage synthesis strategy enables a statistics-driven restricted privacy--prediction trade-off and guarantee optimal prediction performance. We validate our approach and demonstrate its characteristics of being statistics-driven and restricted in achieving the privacy--prediction trade-off both theoretically and numerically. Additionally, we showcase its generalizability through applications to a marketing problem and five real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。