arXiv:2412.18992math.STcs.LG2024-12被引 6

在异构隐私约束下,实现联邦学习中函数均值估计的最优权衡。

Optimal Federated Learning for Functional Mean Estimation under Heterogeneous Privacy Constraints

  • 针对不同服务器的隐私参数和采样差异,提出统一优化框架。
  • 理论证明了隐私与精度间存在可量化的基本代价。
  • 适用于需要跨平台隐私保护的统计分析场景。

联邦学习(FL)是一种分布式机器学习技术,旨在保护数据隐私与安全,因其广泛应用而备受关注。本文研究在联邦设置下,从离散采样数据中进行最优函数均值估计的问题。考虑一个异构框架,其中个体数量、每人测量次数及隐私参数在一台或多台服务器间各不相同,涵盖共同设计与独立设计两种情形。在共同设计中,每个个体在相同的设计点上被测量;而在独立设计中,每个个体拥有自己随机的观测点集合。在此框架内,我们建立了底层均值函数估计误差的极小极大上下界,揭示了在分布式隐私约束下,共同设计与独立设计之间的细微差异。我们提出了达到最优隐私-精度权衡的算法,并给出了可量化私有函数均值估计基本极限的最优性结果。这些成果刻画了隐私的成本,为联邦环境中隐私保护统计分析提供了实用洞见。

原文摘要 · Abstract (English)

Federated learning (FL) is a distributed machine learning technique designed to preserve data privacy and security, and it has gained significant importance due to its broad range of applications. This paper addresses the problem of optimal functional mean estimation from discretely sampled data in a federated setting. We consider a heterogeneous framework where the number of individuals, measurements per individual, and privacy parameters vary across one or more servers, under both common and independent design settings. In the common design setting, the same design points are measured for each individual, whereas in the independent design, each individual has their own random collection of design points. Within this framework, we establish minimax upper and lower bounds for the estimation error of the underlying mean function, highlighting the nuanced differences between common and independent designs under distributed privacy constraints. We propose algorithms that achieve the optimal trade-off between privacy and accuracy and provide optimality results that quantify the fundamental limits of private functional mean estimation across diverse distributed settings. These results characterize the cost of privacy and offer practical insights into the potential for privacy-preserving statistical analysis in federated environments.

联邦学习隐私保护函数估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。