arXiv:2605.21317cs.LG2026-05

解决联邦学习中客户端更新冲突问题,提升模型全局性能与公平性。

CRAFT: Conflict-Resolved Aggregation for Federated Training

论文配图:CRAFT: Conflict-Resolved Aggregation for Federated Training
图 1 · 摘自论文原文
  • 将全局更新建模为几何修正问题,通过约束优化寻找最优方向。
  • 在多个异构数据集上,模型准确率更高且客户端间性能差异更小。
  • 适合关注联邦学习公平性与收敛稳定性的研究者和工程师。

在数据分布异构的联邦学习中,客户端更新的聚合始终是核心瓶颈。简单的平均方法可能导致全局更新虽提升整体目标,却与部分客户端冲突,引发这些客户端性能下降。本文提出CRAFT(冲突化解聚合框架),将全局更新视为几何修正问题,通过求解满足无冲突对齐约束的最近更新方向,实现高效聚合。我们推导出该约束优化问题的闭式解,避免了迭代求解带来的计算开销。此外,采用逐层自适应机制处理不同特征粒度的冲突。理论分析表明,CRAFT能促进共同下降结构,通过投影几何缓解冲突。大量实验验证,在多个异构基准测试中,相比现有先进方法,CRAFT不仅提升了全局模型精度,还显著降低了客户端间的性能差异。代码已开源:https://github.com/tum-pbs/CRAFT。

原文摘要 · Abstract (English)

The aggregation of conflicting client updates remains a fundamental bottleneck in federated learning (FL) under heterogeneous data distributions. Naive averaging can produce a global update that improves the global objective while conflicting with specific clients, causing degradation for those clients. In this work, we propose CRAFT (Conflict-Resolved Aggregation for Federated Training), a new aggregation framework that treats the global update as a geometric correction problem. We formulate aggregation as finding the update closest to a reference direction while satisfying conflict-free alignment constraints. We derive a closed-form expression for the constrained optimization problem, avoiding the computational overhead of iterative solvers. Furthermore, we use a layer-wise adaptation to address conflicts at varying feature granularities. We provide a theoretical analysis showing that CRAFT promotes a common-descent structure and mitigates conflicts through its projection geometry. Extensive experiments on heterogeneous benchmarks demonstrate that CRAFT improves the accuracy of the global model while reducing performance disparity across clients compared with state-of-the-art baselines. The source code for CRAFT is available at https://github.com/tum-pbs/CRAFT.

联邦学习模型聚合公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。