arXiv:2506.06664cs.ROcs.CV2025-06被引 55

统一粗粒度与细粒度轨迹评分,提升自动驾驶规划泛化能力

Generalized Trajectory Scoring for End-to-end Multimodal Planning

  • 用扩散模型生成多样细粒度轨迹提案
  • 通过丢弃正则化训练,使评分器在小样本上仍稳健
  • 融合传感器增强与精炼训练,提升跨场景适应性

端到端多模态规划是自动驾驶中极具前景的范式,可通过多样化轨迹候选进行决策。核心在于鲁棒的轨迹评分机制,以从候选中选出最优路径。现有方法或聚焦静态大集合轨迹评分,或针对动态生成的小集合,但均存在泛化不足问题:静态词汇虽能粗粒度划分,难以精细适配;动态提议虽具高精度,却无法捕捉全局轨迹分布。为此,本文提出GTRS(Generalized Trajectory Scoring),一个统一的端到端多模态规划框架,结合粗粒度与细粒度评估。GTRS包含三项创新:(1) 基于扩散模型的轨迹生成器,生成多样化细粒度轨迹;(2) 词汇泛化技术,在超密集轨迹集上通过丢弃正则化训练评分器,使其在小规模子集上仍可稳健推理;(3) 传感器增强策略,提升域外泛化能力,并引入精炼训练强化关键轨迹判别。GTRS作为Navsim v2挑战赛冠军方案,即使在次优传感器输入下仍表现优异,接近依赖真值感知的特权方法。代码将开源于https://github.com/NVlabs/GTRS。

原文摘要 · Abstract (English)

End-to-end multi-modal planning is a promising paradigm in autonomous driving, enabling decision-making with diverse trajectory candidates. A key component is a robust trajectory scorer capable of selecting the optimal trajectory from these candidates. While recent trajectory scorers focus on scoring either large sets of static trajectories or small sets of dynamically generated ones, both approaches face significant limitations in generalization. Static vocabularies provide effective coarse discretization but struggle to make fine-grained adaptation, while dynamic proposals offer detailed precision but fail to capture broader trajectory distributions. To overcome these challenges, we propose GTRS (Generalized Trajectory Scoring), a unified framework for end-to-end multi-modal planning that combines coarse and fine-grained trajectory evaluation. GTRS consists of three complementary innovations: (1) a diffusion-based trajectory generator that produces diverse fine-grained proposals; (2) a vocabulary generalization technique that trains a scorer on super-dense trajectory sets with dropout regularization, enabling its robust inference on smaller subsets; and (3) a sensor augmentation strategy that enhances out-of-domain generalization while incorporating refinement training for critical trajectory discrimination. As the winning solution of the Navsim v2 Challenge, GTRS demonstrates superior performance even with sub-optimal sensor inputs, approaching privileged methods that rely on ground-truth perception. Code will be available at https://github.com/NVlabs/GTRS.

自动驾驶轨迹评分多模态规划扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。