arXiv:2606.16655cs.LG2026-06中稿 · ICML

用最优传输对齐异构数据分布,提升单轮联邦学习性能

Distribution Alignment for One-Shot Federated Learning via Optimal Transport

论文配图:Distribution Alignment for One-Shot Federated Learning via Optimal Transport
图 1 · 摘自论文原文
  • 通过冻结编码器提取特征统计,构建全局参考
  • 采用闭式测地线传输映射实现局部特征对齐,精度提升显著
  • 无需训练可集成现有方法,适合资源受限场景

单轮联邦学习(OSFL)在客户端仅与服务器交互一次的极端通信条件下,加剧了客户端数据分布的异质性。域偏移和标签偏移共同导致特征表示错位,无法通过迭代优化修复。现有方法依赖知识蒸馏、服务端生成或集成聚合,但通常假设表示对齐,或分别处理两类偏移。本文提出SLOT-Align(单轮、无训练最优传输对齐),一种几何感知的特征调和框架。SLOT-Align使用共享冻结编码器提取紧凑特征统计,通过Bures-Wasserstein均值构建全局参考,并利用闭式测地线最优传输映射对齐本地表示。该方法计算高效,可无缝集成至依赖冻结编码器的现有OSFL流程,且不修改其训练过程。多基准测试结果表明,无论在何种预训练主干网络或OSFL方法下,SLOT-Align均在联合域偏移与标签偏移场景中持续提升准确率与鲁棒性。

原文摘要 · Abstract (English)

One-Shot Federated Learning (OSFL) addresses extreme communication regimes in which clients interact with the server only once, amplifying the impact of heterogeneous client data distributions. In particular, the interaction of domain shift and label shift across clients induces misaligned feature representations that cannot be corrected through iterative optimization. Existing OSFL methods rely on distillation, server-side generation or ensemble-based aggregation, but assume aligned representations or address domain and label shift separately. We introduce SLOT-Align (Single-round, Learning-free Optimal Transport Alignment), a geometry-aware feature harmonization framework for OSFL. SLOT-Align uses a shared frozen encoder to extract compact feature statistics, constructs a global reference via Bures-Wasserstein barycenters, and aligns local representations using closed-form geodesic optimal transport maps. The method is computationally efficient and can be combined with existing OSFL pipelines relying on frozen encoders without modifying their training procedures. Extensive experiments across multiple benchmarks, pretrained backbones, and OSFL methods show that SLOT-Align consistently improves accuracy and robustness under joint domain and label shift.

联邦学习最优传输特征对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。