通过三阶段去噪提升隐私推荐系统的准确率,打破隐私与效果的权衡困境。
DPSR: Differentially Private Sparse Reconstruction via Multi-Stage Denoising for Recommender Systems
- 先加噪后去噪:利用后处理免疫性,在保证差分隐私前提下清除噪声。
- 三阶段协同去噪:信息量大的评分降噪,基于相似性修复,低秩补全恢复信号。
- 在ε=1.0时精度超无隐私基线,适合高隐私需求下的推荐系统优化。
差分隐私已成为推荐系统保护用户数据的黄金标准,但现有机制面临隐私-效用权衡的固有挑战:随着隐私预算收紧,推荐质量不可避免下降。本文提出DPSR(差分隐私稀疏重构),一种三阶段去噪框架,通过挖掘评分矩阵的稀疏性、低秩特性和协同模式来根本解决此问题。DPSR包含三个协同阶段:(1) 信息论噪声校准,自适应降低高信息量评分的噪声;(2) 基于协同过滤的去噪,利用物品间相似性消除隐私噪声;(3) 低秩矩阵补全,挖掘潜在结构恢复信号。关键在于所有去噪操作均在加噪之后进行,利用后处理免疫定理保持差分隐私,同时去除隐私引入和数据本身噪声。在具有可控真实值的合成数据集上实验表明,当隐私预算ε从0.1到10.0时,DPSR相较最先进的拉普拉斯和高斯机制,RMSE提升5.57%至9.23%(所有改进均统计显著,p<0.05,多数p<0.001)。尤为突出的是,在ε=1.0时,DPSR达到RMSE 0.9823,甚至优于非私有基线(1.0983),证明该去噪流程不仅清除隐私噪声,还有效移除数据噪声,起到正则化作用。
原文摘要 · Abstract (English)
Differential privacy (DP) has emerged as the gold standard for protecting user data in recommender systems, but existing privacy-preserving mechanisms face a fundamental challenge: the privacy-utility tradeoff inevitably degrades recommendation quality as privacy budgets tighten. We introduce DPSR (Differentially Private Sparse Reconstruction), a novel three-stage denoising framework that fundamentally addresses this limitation by exploiting the inherent structure of rating matrices -- sparsity, low-rank properties, and collaborative patterns. DPSR consists of three synergistic stages: (1) \textit{information-theoretic noise calibration} that adaptively reduces noise for high-information ratings, (2) \textit{collaborative filtering-based denoising} that leverages item-item similarities to remove privacy noise, and (3) \textit{low-rank matrix completion} that exploits latent structure for signal recovery. Critically, all denoising operations occur \textit{after} noise injection, preserving differential privacy through the post-processing immunity theorem while removing both privacy-induced and inherent data noise. Through extensive experiments on synthetic datasets with controlled ground truth, we demonstrate that DPSR achieves 5.57\% to 9.23\% RMSE improvement over state-of-the-art Laplace and Gaussian mechanisms across privacy budgets ranging from $\varepsilon=0.1$ to $\varepsilon=10.0$ (all improvements statistically significant with $p < 0.05$, most $p < 0.001$). Remarkably, at $\varepsilon=1.0$, DPSR achieves RMSE of 0.9823, \textit{outperforming even the non-private baseline} (1.0983), demonstrating that our denoising pipeline acts as an effective regularizer that removes data noise in addition to privacy noise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。