让真人参与决策,让联邦学习在保护隐私的同时提升模型精度。
An Interactive Framework for Implementing Privacy-Preserving Federated Learning: Experiments on Large Language Models
- 引入人类隐私实践者,动态调节隐私与模型性能的平衡。
- 在资源受限设备上实现稳定内存占用,ε=10时准确率仅降1.33%。
- 适用于手机等低配设备,适合医疗、金融等敏感场景应用。
联邦学习通过将用户数据保留在本地来增强隐私,但最新攻击表明训练过程中共享的更新可能泄露大量数据信息,严重阻碍其在敏感领域的应用。差分隐私(DP)被视为保障用户数据的标准方法,但其保证过于保守,常高估隐私需求,影响模型准确性,且不同场景下的解释复杂。本文提出一个融合人类隐私实践者的交互框架,以实现隐私与模型效用间的最优权衡。该框架首次解决现有DP方法在联邦学习中内存需求可变的问题,支持资源受限设备参与。采用固定内存的新型DP方法,确保可扩展性。我们在基于BERT的大型语言模型上使用GLUE数据集进行微调实验,结合新会计机制和多种数据划分策略模拟真实场景。结果表明,内存使用稳定,当ε=10时平均准确率下降1.33%,ε=6时下降1.9%,优于不支持固定内存的先进会计方法。
原文摘要 · Abstract (English)
Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has greatly thwart the adoption of FL methods for training robust AI models in sensitive applications. Differential Privacy (DP) is considered the gold standard for safeguarding user data. However, DP guarantees are highly conservative, providing worst-case privacy guarantees. This can result in overestimating privacy needs, which may compromise the model's accuracy. Additionally, interpretations of these privacy guarantees have proven to be challenging in different contexts. This is further exacerbated when other factors, such as the number of training iterations, data distribution, and specific application requirements, can add further complexity to this problem. In this work, we proposed a framework that integrates a human entity as a privacy practitioner to determine an optimal trade-off between the model's privacy and utility. Our framework is the first to address the variable memory requirement of existing DP methods in FL settings, where resource-limited devices (e.g., cell phones) can participate. To support such settings, we adopt a recent DP method with fixed memory usage to ensure scalable private FL. We evaluated our proposed framework by fine-tuning a BERT-based LLM model using the GLUE dataset (a common approach in literature), leveraging the new accountant, and employing diverse data partitioning strategies to mimic real-world conditions. As a result, we achieved stable memory usage, with an average accuracy reduction of 1.33% for $ε= 10$ and 1.9% for $ε= 6$, when compared to the state-of-the-art DP accountant which does not support fixed memory usage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。