arXiv:2602.01126cs.LG2026-02被引 2

解决隐私差异下联邦LoRA的激励错配问题,提升模型性能与客户端收益。

WinFLoRA: Incentivizing Client-Adaptive Aggregation in Federated LoRA under Privacy Heterogeneity

  • 用噪声感知的加权聚合,让低隐私噪声贡献者获得更多权重奖励。
  • 在多个LLM和数据集上,全局准确率最高提升52.58%,客户端效用提升2.56倍。
  • 无需第三方,自动对齐客户端隐私保护与模型性能目标,适合高隐私敏感场景。

大型语言模型(LLMs)广泛应用于聊天机器人、搜索与推荐等智能网络服务,高效定制化至关重要。低秩适配(LoRA)以极小开销实现模型定制,联邦LoRA则允许服务提供商在不共享数据的前提下微调共享模型。然而,在隐私敏感部署中,各客户端注入不同水平的差分隐私(DP)噪声,导致隐私异构性,使个体激励与全局性能脱节。本文提出WinFLoRA,一种面向隐私异构性的联邦LoRA方法,利用聚合权重作为激励并具备噪声感知能力。具体而言,通过上传的LoRA适配器估计客户端噪声水平;较大权重意味着对全局模型影响更大,下游任务表现更优,从而奖励低噪声贡献。通过加权低噪声更新,WinFLoRA在满足客户端异构隐私需求的同时提升全局准确率。实验表明,跨多个LLM与数据集,相比现有基准,其全局准确率最高提升52.58%,客户端效用最高提升2.56倍。代码已开源:https://github.com/koums24/WinFLoRA.git。

原文摘要 · Abstract (English)

Large Language Models (LLMs) increasingly underpin intelligent web applications, from chatbots to search and recommendation, where efficient specialization is essential. Low-Rank Adaptation (LoRA) enables such adaptation with minimal overhead, while federated LoRA allows web service providers to fine-tune shared models without data sharing. However, in privacy-sensitive deployments, clients inject varying levels of differential privacy (DP) noise, creating privacy heterogeneity that misaligns individual incentives and global performance. In this paper, we propose WinFLoRA, a privacy-heterogeneous federated LoRA that utilizes aggregation weights as incentives with noise awareness. Specifically, the noises from clients are estimated based on the uploaded LoRA adapters. A larger weight indicates greater influence on the global model and better downstream task performance, rewarding lower-noise contributions. By up-weighting low-noise updates, WinFLoRA improves global accuracy while accommodating clients' heterogeneous privacy requirements. Consequently, WinFLoRA aligns heterogeneous client utility in terms of privacy and downstream performance with global model objectives without third-party involvement. Extensive evaluations demonstrate that across multiple LLMs and datasets, WinFLoRA achieves up to 52.58% higher global accuracy and up to 2.56x client utility than state-of-the-art benchmarks. Source code is publicly available at https://github.com/koums24/WinFLoRA.git.

联邦学习隐私保护LoRA激励机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。