提出新聚合方法,让不同任务在联邦学习中协同训练而不互相干扰。
Towards Unified Modeling in Federated Multi-Task Learning via Subspace Decoupling
- 根据本地更新强度动态识别相关维度,实现任务解耦聚合。
- 在NYUD-V2和PASCAL-Context上性能显著提升,跨任务泛化强。
- 无需标签或结构修改,可无缝接入主流优化算法。
联邦多任务学习(FMTL)允许多个客户端在不共享本地数据的情况下执行异构任务,具有保护隐私的多任务协作潜力。然而,现有方法多聚焦于为每个客户端构建个性化模型,难以将多种异构任务整合到统一模型中。在任务目标、标签空间和优化路径差异较大的真实场景下,传统FMTL方法难以实现有效联合训练。为此,我们提出FedDEA(联邦解耦聚合),一种更新结构感知的聚合方法,专为多任务模型集成设计。该方法基于本地更新的响应强度动态识别任务相关维度,并通过重缩放增强其优化效果,有效抑制跨任务干扰,实现在统一全局模型内的任务级解耦聚合。FedDEA不依赖任务标签或架构修改,具备广泛适用性和部署友好性。实验表明,它可轻松集成至多种主流联邦优化算法,在广泛使用的NYUD-V2和PASCAL-Context数据集上持续带来显著整体性能提升,验证了其在高度异构任务设置下的鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Federated Multi-Task Learning (FMTL) enables multiple clients performing heterogeneous tasks without exchanging their local data, offering broad potential for privacy preserving multi-task collaboration. However, most existing methods focus on building personalized models for each client and unable to support the aggregation of multiple heterogeneous tasks into a unified model. As a result, in real-world scenarios where task objectives, label spaces, and optimization paths vary significantly, conventional FMTL methods struggle to achieve effective joint training. To address this challenge, we propose FedDEA (Federated Decoupled Aggregation), an update-structure-aware aggregation method specifically designed for multi-task model integration. Our method dynamically identifies task-relevant dimensions based on the response strength of local updates and enhances their optimization effectiveness through rescaling. This mechanism effectively suppresses cross-task interference and enables task-level decoupled aggregation within a unified global model. FedDEA does not rely on task labels or architectural modifications, making it broadly applicable and deployment-friendly. Experimental results demonstrate that it can be easily integrated into various mainstream federated optimization algorithms and consistently delivers significant overall performance improvements on widely used NYUD-V2 and PASCAL-Context. These results validate the robustness and generalization capabilities of FedDEA under highly heterogeneous task settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。