通过通道级特征对齐,实现个性化单轮联邦学习
CRIP: Channel Level Representation Injection for Personalized One-Shot Federated Learning

- 在表示空间中按通道级对齐特征,避免跨域噪声
- 仅融合与目标客户端最相似的特征,提升适应性
- 适合极端域异构场景下的个性化模型训练
单轮联邦学习(OSFL)作为一种高效协同建模框架,仅需一轮通信即可实现模型训练,在通信效率和隐私保护方面具有显著优势。然而,在客户端存在严重域异构时,由于缺乏迭代知识交换,性能常受限制。现有方法多依赖外部公开数据集进行知识蒸馏或使用参数级聚合统计信息,忽视了域异构带来的特征分布偏移。为此,我们提出CRIP,一种在表示空间中通过通道级特征对齐实现个性化的单轮联邦学习框架。各客户端将特征提取器上传至服务器,服务器将所有提取器广播回各客户端。由于并非所有源客户端的特征分布均与目标客户端兼容,盲目融合会引入域特异性噪声。因此,CRIP在小规模本地批次上衡量目标客户端与各源客户端之间的通道级表示相似性,并仅选择最匹配的特征进行融合。在DomainNet、PACS和Office-Home等域异构基准上的大量实验表明,CRIP持续优于本地模型及当前最优基线,验证了在极端域异构下表示空间个性化策略的有效性。
原文摘要 · Abstract (English)
One-shot federated learning (OSFL) has emerged as a promising collaborative model learning framework with only a single round of communication, offering significant advantages in communication efficiency and privacy preservation. However, OSFL often faces inherent limitations under severe domain heterogeneity across clients due to the lack of iterative knowledge exchange. Most existing OSFL methods require an auxiliary public dataset for knowledge distillation or leverage statistical information for parameter-level aggregation, overlooking feature shift caused by domain heterogeneity. To address these challenges, we propose CRIP, a personalized OSFL framework that operates in the representation space via channel-level feature alignment. To achieve this, each client uploads its feature extractor to the server, which broadcasts all extractors back to every client. Since not all source clients share compatible feature distributions with the target client, indiscriminate fusion of cross-client features would introduce domain-specific noise. Therefore, CRIP effectively measures the channel-wise representational similarity between the target client and each source client on a small local mini-batch, and selectively fuses only the most compatible features. Extensive experiments on domain-heterogeneous benchmarks such as DomainNet, PACS, and Office-Home demonstrate that CRIP consistently outperforms local models and state-of-the-art baselines, validating the effectiveness of representation-space personalization under extreme domain heterogeneity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。