arXiv:2501.13604cs.LGcs.DC2025-01中稿 · ACM ToMPECS journa…被引 7

解决联邦学习中用户偏好不一致的问题,实现个性化模型训练。

FedPref: Federated Learning Across Heterogeneous Multi-objective Preferences

  • 提出新算法 FedPref,应对不同客户端对多目标的偏好差异。
  • 在多种任务和模型架构下,性能优于现有方法。
  • 引入多目标评估视角,超越传统以客户端为中心的评价方式。

联邦学习(FL)是一种分布式机器学习策略,适用于训练数据分散在多个设备且无法共享的场景。该方法通过分布式训练模型,定期交换并聚合本地模型参数以提升整体精度,已在工业界广泛应用以克服隐私与资源限制。然而,将联邦学习应用于真实场景时,参与者间的异质性带来了新挑战。现有研究主要关注两类异质性:数据分布不均和客户端资源差异。随着联邦学习扩展至大模型微调、边缘设备推理等复杂任务,另一类重要异质性——偏好异质性——日益凸显:即不同客户端在多目标学习中对各目标赋予不同权重。本文探讨该异质性的影响,并首次提出 FedPref 算法,支持在此情境下的个性化联邦学习。实验表明,该算法在多种任务、偏好分布及模型架构下均有效。此外,我们引入基于多目标指标的新分析视角,超越传统以客户端为中心的评估方式,并进一步验证了 FedPref 的优越性。

原文摘要 · Abstract (English)

Federated Learning (FL) is a distributed machine learning strategy, developed for settings where training data is owned by distributed devices and cannot be shared. FL circumvents this constraint by carrying out model training in distribution. The parameters of these local models are shared intermittently among participants and aggregated to enhance model accuracy. This strategy has been rapidly adopted by the industry in efforts to overcome privacy and resource constraints in model training. However, the application of FL to real-world settings brings additional challenges associated with heterogeneity between participants. Research into mitigating these difficulties in FL has largely focused on only two types of heterogeneity: the unbalanced distribution of training data, and differences in client resources. Yet more types of heterogeneity are becoming relevant as the capability of FL expands to cover more complex problems, from the tuning of LLMs to enabling machine learning on edge devices. In this work, we discuss a novel type of heterogeneity that is likely to become increasingly relevant in future applications: this is preference heterogeneity, emerging when clients learn under multiple objectives, with different importance assigned to each objective on different clients. In this work, we discuss the implications of this type of heterogeneity and propose FedPref, a first algorithm designed to facilitate personalised FL in this setting. We demonstrate the effectiveness of the algorithm across different problems, preference distributions and model architectures. In addition, we introduce a new analytical point of view, based on multi-objective metrics, for evaluating the performance of FL algorithms in this setting beyond the traditional client-focused metrics. We perform a second experimental analysis based in this view, and show that FedPref outperforms compared algorithms.

联邦学习多目标优化个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。