arXiv:2512.06676cs.ROcs.LG2025-12

FedDSR提升自动驾驶联邦学习的泛化与收敛速度

FedDSR: Federated Deep Supervision and Regularization Towards Autonomous Driving

  • 在中间层引入互信息与负熵作为监督与正则项
  • 相较基线模型,mIoU最高提升8.93%,训练轮次减少28.57%
  • 适用于多架构、多算法的自动驾驶联邦学习场景

联邦学习(FL)可在保护数据隐私的前提下,实现分布式车辆间的自动驾驶(AD)模型协同训练。然而,由于不同驾驶环境导致的数据非独立同分布(non-IID),FL面临泛化能力差与收敛慢的问题。为此,本文提出联邦深度监督与正则化(FedDSR)框架,在联邦AD系统中引入多层级中间层监督与正则化机制。具体包括:(I)基于与架构无关的标准选择多个中间层;(II)在这些层上计算互信息(MI)和负熵(NE),作为中间损失与正则项,融入输出层损失形成统一优化目标,实现全网络层级的联合优化;(III)基于上述规则聚合各车辆模型,生成中心服务器上的全局模型。通过引导并惩罚中间阶段特征表示的学习,FedDSR提升了模型泛化能力并加速收敛。以语义分割任务为例,实验验证了其在多种模型架构与联邦算法下的有效性。结果表明,相较其他联邦学习基线,FedDSR在mIoU上最高提升8.93%,训练轮次减少28.57%,具备良好的实际部署潜力。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative training of autonomous driving (AD) models across distributed vehicles while preserving data privacy. However, FL encounters critical challenges such as poor generalization and slow convergence due to non-independent and identically distributed (non-IID) data from diverse driving environments. To overcome these obstacles, we introduce Federated Deep Supervision and Regularization (FedDSR), a paradigm that incorporates multi-access intermediate layer supervision and regularization within federated AD system. Specifically, FedDSR comprises following integral strategies: (I) to select multiple intermediate layers based on predefined architecture-agnostic standards. (II) to compute mutual information (MI) and negative entropy (NE) on those selected layers to serve as intermediate loss and regularizer. These terms are integrated into the output-layer loss to form a unified optimization objective, enabling comprehensive optimization across the network hierarchy. (III) to aggregate models from vehicles trained based on aforementioned rules of (I) and (II) to generate the global model on central server. By guiding and penalizing the learning of feature representations at intermediate stages, FedDSR enhances the model generalization and accelerates model convergence for federated AD. We then take the semantic segmentation task as an example to assess FedDSR and apply FedDSR to multiple model architectures and FL algorithms. Extensive experiments demonstrate that FedDSR achieves up to 8.93% improvement in mIoU and 28.57% reduction in training rounds, compared to other FL baselines, making it highly suitable for practical deployment in federated AD ecosystems.

联邦学习自动驾驶深度监督正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。