arXiv:2505.00318cs.ROcs.LG2025-05被引 9

解决自动驾驶模型在联邦学习中因环境变化导致的遗忘问题。

FedEMA: Federated Exponential Moving Averaging with Negative Entropy Regularizer in Autonomous Driving

  • 用指数移动平均保留历史模型,防止知识丢失。
  • 车辆端引入负熵正则化,避免过拟合临时模式。
  • 在城市场景和Camvid数据集上提升mIoU达7.12%。

道路场景语义理解(S3U)是自动驾驶的关键但复杂任务,其推理模型常因领域偏移导致泛化能力差。联邦学习(FL)通过隐私保护的分布式学习提升模型泛化性,但在动态演变环境中部署时面临显著的时间灾难性遗忘问题,持续适应会突然侵蚀历史知识。本文提出联邦指数移动平均(FedEMA)框架,通过两项创新解决此问题:(I) 服务端融合当前轮次聚合模型与前一轮次的指数移动平均(EMA)模型,保留历史拟合能力;(II) 车辆端采用负熵正则化,防止模型对EMA引入的时间模式过拟合。上述策略实现兼顾泛化与适应性的双目标优化。我们还对FedEMA进行了理论收敛性分析。大量实验在Cityscapes和Camvid数据集上验证了其优越性,相较现有方法提升7.12%的平均交并比(mIoU)。

原文摘要 · Abstract (English)

Street Scene Semantic Understanding (denoted as S3U) is a crucial but complex task for autonomous driving (AD) vehicles. Their inference models typically face poor generalization due to domain-shift. Federated Learning (FL) has emerged as a promising paradigm for enhancing the generalization of AD models through privacy-preserving distributed learning. However, these FL AD models face significant temporal catastrophic forgetting when deployed in dynamically evolving environments, where continuous adaptation causes abrupt erosion of historical knowledge. This paper proposes Federated Exponential Moving Average (FedEMA), a novel framework that addresses this challenge through two integral innovations: (I) Server-side model's historical fitting capability preservation via fusing current FL round's aggregation model and a proposed previous FL round's exponential moving average (EMA) model; (II) Vehicle-side negative entropy regularization to prevent FL models' possible overfitting to EMA-introduced temporal patterns. Above two strategies empower FedEMA a dual-objective optimization that balances model generalization and adaptability. In addition, we conduct theoretical convergence analysis for the proposed FedEMA. Extensive experiments both on Cityscapes dataset and Camvid dataset demonstrate FedEMA's superiority over existing approaches, showing 7.12% higher mean Intersection-over-Union (mIoU).

联邦学习自动驾驶语义分割模型记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。