兼顾隐私与公平的新型强化学习算法,可同时保护用户数据并避免决策偏倚。
DP-NCB: Privacy Preserving Fair Bandits
- 提出统一框架DP-NCB,同步实现差分隐私与最优公平性
- 在合成数据上显著降低纳什后悔值,优于现有方法
- 适用于医疗等高风险场景,无需预知时间长度
多臂老虎机算法是不确定环境下序列决策的核心工具,广泛应用于临床试验与个性化决策。随着其在社会敏感场景中的部署增多,保护用户隐私并确保各轮决策公平变得至关重要。现有工作分别研究隐私或公平问题,但两者能否兼顾仍不明确。已有隐私算法侧重最小化平均后悔,而公平算法关注纳什后悔以惩罚收益不均,却常忽视隐私。本文提出差分隐私纳什置信边界(DP-NCB)——一种统一框架,在全局与本地差分隐私模型下均能实现ε-差分隐私,并达到近乎最优的纳什后悔,逼近已知下界(对数因子内)。该算法为任意时序设计,无需预先知晓时间范围。仿真结果表明,相比最先进基线,DP-NCB在合成实例中显著降低纳什后悔。研究成果为高影响、高风险应用提供了兼具隐私与公平性的算法基础。
原文摘要 · Abstract (English)
Multi-armed bandit algorithms are fundamental tools for sequential decision-making under uncertainty, with widespread applications across domains such as clinical trials and personalized decision-making. As bandit algorithms are increasingly deployed in these socially sensitive settings, it becomes critical to protect user data privacy and ensure fair treatment across decision rounds. While prior work has independently addressed privacy and fairness in bandit settings, the question of whether both objectives can be achieved simultaneously has remained largely open. Existing privacy-preserving bandit algorithms typically optimize average regret, a utilitarian measure, whereas fairness-aware approaches focus on minimizing Nash regret, which penalizes inequitable reward distributions, but often disregard privacy concerns. To bridge this gap, we introduce Differentially Private Nash Confidence Bound (DP-NCB)-a novel and unified algorithmic framework that simultaneously ensures $ε$-differential privacy and achieves order-optimal Nash regret, matching known lower bounds up to logarithmic factors. The framework is sufficiently general to operate under both global and local differential privacy models, and is anytime, requiring no prior knowledge of the time horizon. We support our theoretical guarantees with simulations on synthetic bandit instances, showing that DP-NCB incurs substantially lower Nash regret than state-of-the-art baselines. Our results offer a principled foundation for designing bandit algorithms that are both privacy-preserving and fair, making them suitable for high-stakes, socially impactful applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。