DriveFine用分块专家混合提升自动驾驶生成模型精度与鲁棒性。
DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving
- 引入可插拔的块-MoE结构,实现生成与修正专家分离。
- 在NAVSIM v1/v2和Navhard上表现优于现有方法,推理更稳定。
- 适合追求高精度自动驾驶规划的开发者与研究者。
面向自动驾驶的视觉-语言-动作(VLA)模型多采用模仿学习结合强化学习训练的生成式规划器。基于扩散的规划器存在模态对齐难、训练效率低、泛化能力弱的问题;基于令牌的规划器则面临累积因果误差与不可逆解码缺陷。本文提出DriveFine,一种增强型掩码扩散VLA模型,融合灵活解码与自纠错能力。设计新型可插拔块-MoE结构,在生成专家之上注入修正专家。通过推理时显式选择专家、训练时梯度阻断,两个专家完全解耦,保留预训练权重的基础能力与通用模式,体现块-MoE设计的灵活性与可扩展性。此外,设计混合强化学习策略,有效探索修正专家的同时保持训练稳定性。在NAVSIM v1、v2及Navhard基准上的大量实验表明,DriveFine展现出强大有效性与鲁棒性。代码将开源于https://github.com/MSunDYY/DriveFine。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models for autonomous driving increasingly adopt generative planners trained with imitation learning followed by reinforcement learning. Diffusion-based planners suffer from modality alignment difficulties, low training efficiency, and limited generalization. Token-based planners are plagued by cumulative causal errors and irreversible decoding. In summary, the two dominant paradigms exhibit complementary strengths and weaknesses. In this paper, we propose DriveFine, a masked diffusion VLA model that combines flexible decoding with self-correction capabilities. In particular, we design a novel plug-and-play block-MoE, which seamlessly injects a refinement expert on top of the generation expert. By enabling explicit expert selection during inference and gradient blocking during training, the two experts are fully decoupled, preserving the foundational capabilities and generic patterns of the pretrained weights, which highlights the flexibility and extensibility of the block-MoE design. Furthermore, we design a hybrid reinforcement learning strategy that encourages effective exploration of refinement expert while maintaining training stability. Extensive experiments on NAVSIM v1, v2, and Navhard benchmarks demonstrate that DriveFine exhibits strong efficacy and robustness. The code will be released at https://github.com/MSunDYY/DriveFine.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。