arXiv:2512.06664cs.RO2025-12

通过统计增强解耦路由与聚合,提升自动驾驶场景下的模型适应能力。

Statistic-Augmented, Decoupled MoE Routing and Aggregating in Autonomous Driving

  • 用统计检索匹配专家原型特征,精准选择合适专家
  • 根据专家特征与隐状态的统计距离动态加权融合结果
  • 在复杂驾驶场景中显著优于传统单模型和MoE基线

自动驾驶场景具有高度复杂性和多样性,单一深度学习模型难以覆盖所有可能条件(如天气、车流密度、道路类型)。基于大模型驱动的混合专家(MoE)框架通过大模型提取潜在特征,由MoE动态选择并聚合专用专家以适应不同场景。然而,现有MoE在路由与聚合环节存在缺陷:路由策略不精准导致专家选择偏差,聚合效率低影响预测效果。为此,本文提出一种统计增强型、解耦式MoE路由与聚合机制(MoE-RAM),依托大模型实现。一方面,通过引入统计检索机制,将大模型提取的潜在特征与缓存的专家原型特征匹配,提升路由精度;另一方面,通过测量专家即时特征与大模型隐状态之间的统计距离,自适应重加权专家输出进行融合。得益于统计增强的路由与聚合协同,MoE-RAM显著提升预测性能。以自动驾驶语义分割任务为例,在多个自动驾驶数据集上的实验表明,该方法优于其他MoE基线及传统单模型方法。

原文摘要 · Abstract (English)

Autonomous driving (AD) scenarios are inherently complex and diverse, posing significant challenges for a single deep learning model to effectively cover all possible conditions, such as varying weather, traffic densities, and road types. Large Model (LM)-Driven Mixture of Experts (MoE) paradigm offers a promising solution, where LM serves as the backbone to extract latent features while MoE serves as the downstream head to dynamically select and aggregate specialized experts to adapt to different scenarios. However, routing and aggregating in MoE face intrinsic challenges, including imprecise expert selection due to flawed routing strategy and inefficient expert aggregation leading to suboptimal prediction. To address these issues, we propose a statistic-augmented, decoupled MoE }outing and Aggregating Mechanism (MoE-RAM) driven by LM. Specifically, on the one hand, MoE-RAM enhances expert routing by incorporating statistical retrieval mechanism to match LM-extracted latent features with cached prototypical features of the most relevant experts; on the other hand, MoE-RAM adaptively reweights experts' outputs in fusion by measuring statistical distances of experts' instant features against LM-extracted latent features. Benefiting from the synergy of the statistic-augmented MoE's routing and aggregating, MoE-RAM ultimately improves the prediction performance. We take the AD semantic segmentation task as an example to assess the proposed MoE-RAM. Extensive experiments on AD datasets demonstrate the superiority of MoE-RAM compared to other MoE baselines and conventional single-model approaches.

自动驾驶混合专家模型路由

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。