提出交互式框架,高效找到隐私与准确率的最佳平衡。
An Interactive Framework for Finding the Optimal Trade-off in Differential Privacy
- 直接建模隐私-准确率帕累托前沿,利用固定隐私下最大化准确率的特性
- 用假设性曲线选择替代传统两两比较,减少用户交互次数
- 在6个真实数据集上显著降低计算开销和交互成本
差分隐私(DP)是隐私保护分析的标准,其核心是在隐私保障与模型性能之间存在根本权衡。寻找最优平衡是一项关键挑战,可建模为多目标优化(MOO)问题:先发现最优权衡集合(帕累托前沿),再学习决策者对这些权衡的偏好。尽管已有大量关于交互式多目标优化的研究,但标准方法——使用通用代理模型并从简单成对反馈中学习偏好——在差分隐私场景中效率低下,因为它未能利用该问题的独特结构:固定隐私水平下,可通过最大化准确率直接生成帕累托前沿上的点。基于此特性,我们首先从理论上推导出权衡曲线的形状,从而能够直接、高效地建模帕累托前沿。为提升偏好学习效率,我们用更具信息量的交互方式替代成对比较:向用户展示假设性的权衡曲线,并请其选择最偏好的一条。在六个真实世界数据集上的差分私有逻辑回归与深度迁移学习实验表明,我们的方法以远低于基线的计算成本和用户交互次数,收敛到最优隐私-准确率权衡。
原文摘要 · Abstract (English)
Differential privacy (DP) is the standard for privacy-preserving analysis, and introduces a fundamental trade-off between privacy guarantees and model performance. Selecting the optimal balance is a critical challenge that can be framed as a multi-objective optimization (MOO) problem where one first discovers the set of optimal trade-offs (the Pareto front) and then learns a decision-maker's preference over them. While a rich body of work on interactive MOO exists, the standard approach -- modeling the objective functions with generic surrogates and learning preferences from simple pairwise feedback -- is inefficient for DP because it fails to leverage the problem's unique structure: a point on the Pareto front can be generated directly by maximizing accuracy for a fixed privacy level. Motivated by this property, we first derive the shape of the trade-off theoretically, which allows us to model the Pareto front directly and efficiently. To address inefficiency in preference learning, we replace pairwise comparisons with a more informative interaction. In particular, we present the user with hypothetical trade-off curves and ask them to pick their preferred trade-off. Our experiments on differentially private logistic regression and deep transfer learning across six real-world datasets show that our method converges to the optimal privacy-accuracy trade-off with significantly less computational cost and user interaction than baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。