arXiv:2410.05982cs.CVcs.RO2024-10NeurIPS被引 32

将轨迹预测拆解为方向意图与动态状态,提升自动驾驶安全性。

DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic States

  • 分离方向意图与动态状态,分步优化多模态和时序演化。
  • 在Argoverse 2和nuScenes上达到当前最佳性能。
  • 适合关注自动驾驶轨迹预测的工程师与研究者。

准确预测交通参与者运动对保障自动驾驶系统在动态环境中的安全与效率至关重要。主流方法采用一查询一轨迹范式,每个查询对应一个独特轨迹以预测多模态轨迹。尽管简单有效,但缺乏对未来轨迹的详细表征,可能导致次优结果,因参与者状态随时间动态演化。为此,我们提出DeMo框架,将多模态轨迹查询解耦为两类:捕捉不同方向意图的模式查询,以及跟踪代理动态状态的时间序列查询。通过此结构,分别优化轨迹的多模态性与时序演化特性。随后融合模式与状态查询,获得完整且详细的轨迹表征。为实现该过程,引入结合注意力机制与Mamba的混合架构,分别实现全局信息聚合与状态序列建模。在Argoverse 2与nuScenes基准上的大量实验表明,DeMo在运动预测任务中达到当前最优表现。

原文摘要 · Abstract (English)

Accurate motion forecasting for traffic agents is crucial for ensuring the safety and efficiency of autonomous driving systems in dynamically changing environments. Mainstream methods adopt a one-query-one-trajectory paradigm, where each query corresponds to a unique trajectory for predicting multi-modal trajectories. While straightforward and effective, the absence of detailed representation of future trajectories may yield suboptimal outcomes, given that the agent states dynamically evolve over time. To address this problem, we introduce DeMo, a framework that decouples multi-modal trajectory queries into two types: mode queries capturing distinct directional intentions and state queries tracking the agent's dynamic states over time. By leveraging this format, we separately optimize the multi-modality and dynamic evolutionary properties of trajectories. Subsequently, the mode and state queries are integrated to obtain a comprehensive and detailed representation of the trajectories. To achieve these operations, we additionally introduce combined Attention and Mamba techniques for global information aggregation and state sequence modeling, leveraging their respective strengths. Extensive experiments on both the Argoverse 2 and nuScenes benchmarks demonstrate that our DeMo achieves state-of-the-art performance in motion forecasting.

轨迹预测自动驾驶多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。