解决联邦学习中个性化与全局性能的矛盾,提升隐私保护下的模型效果。
Global Federated Learning Strategies for Building Efficient Personalized Models
- 针对数据异构性,通过修复特征表示差异来增强全局训练。
- 结合特征蒸馏实现本地对齐与全局知识保留,避免遗忘。
- 发现单个全局初始化在充分微调下更优,适用于个性化推荐场景。
联邦学习(FL)可在保障数据隐私的前提下训练分布式用户数据上的模型,但因各用户数据分布差异大,常导致全局与个性化性能同时下降。本文提出高效个性化模型构建方法:首先,发现随着数据异构性增加,特征向量坍缩比分类器权重问题更根本,提出直接缓解局部与全局模型间表示幅度差异的方法;其次,分析强化本地对齐会引发全局知识遗忘(如本地未见类别),提出基于全局模型特征向量的特征蒸馏方法,兼顾本地对齐与全局知识保留;第三,在偏好异构的联邦个性化奖励模型学习中,实证验证了“增加全局模型数量可更好初始化”的传统观点,表明在充分本地微调条件下,单一全局初始化反而能提供更强个性化表现。本研究重新定义了异构环境下全局初始化的作用,提供了兼顾全局知识保存与个性化性能的实用训练策略。
原文摘要 · Abstract (English)
Federated learning (FL) is a practical framework that can train models on distributed user data while guaranteeing data privacy; however, due to heterogeneity in which each user has a different data distribution, problems frequently arise where both global and personalization performance deteriorate simultaneously. This dissertation presents methodologies for building efficient personalized models by identifying which strategies are effective in the global training stage and by showing how to preserve global knowledge while securing user-specific performance during local adaptation. First, we show that as data heterogeneity increases, the collapse of feature vectors is a more fundamental bottleneck than classifier weights, and propose a method that directly mitigates the discrepancy in representation magnitude between local and global models. Second, we analyze that a training approach that strengthens local alignment can induce forgetting of global knowledge (e.g., categories not observed locally), and propose a method that achieves both local alignment and global knowledge preservation by combining feature distillation based on the global model's feature vectors. Third, in federated personalized reward model learning with preference heterogeneity, we empirically verify the conventional belief that "increasing the number of global models yields better initialization," and we show that when sufficient local fine-tuning is allowed, a single global initialization can instead provide stronger personalization performance. This study redefines the role of global initialization under data and preference heterogeneity and provides practical training strategies that simultaneously satisfy global knowledge preservation and personalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。