用状态空间模型高效构建在线矢量高精地图,提升感知鲁棒性。
MambaMap: Online Vectorized HD Map Construction using State Space Model
- 基于状态空间模型融合长时序特征,动态更新鸟瞰图与实例查询。
- 在nuScenes和Argoverse2上实现更优的预测精度与时间一致性。
- 适合需要实时高精地图构建的自动驾驶系统研发人员。
高精地图对自动驾驶至关重要,可为下游任务提供精确道路信息。近期研究显示,时间建模有助于缓解遮挡和扩展感知范围的问题。然而,现有方法或未能充分利用时序信息,或在处理长序列时带来巨大计算开销。为此,我们提出MambaMap,一种高效融合状态空间中长时序特征以构建在线矢量高精地图的新框架。具体地,MambaMap引入记忆库存储历史帧信息,动态更新鸟瞰图特征与实例查询,增强对噪声和遮挡的鲁棒性;同时,在状态空间中设计门控机制,以高效率选择性整合地图元素间的依赖关系。此外,我们提出创新的多方向与时空扫描策略,显著提升鸟瞰图与实例级别的特征提取能力。这些策略大幅提高预测准确性并保证时间一致性。在nuScenes和Argoverse2数据集上的大量实验表明,MambaMap在多个分割和感知范围下均优于当前最先进方法。源代码将公开于https://github.com/ZiziAmy/MambaMap。
原文摘要 · Abstract (English)
High-definition (HD) maps are essential for autonomous driving, as they provide precise road information for downstream tasks. Recent advances highlight the potential of temporal modeling in addressing challenges like occlusions and extended perception range. However, existing methods either fail to fully exploit temporal information or incur substantial computational overhead in handling extended sequences. To tackle these challenges, we propose MambaMap, a novel framework that efficiently fuses long-range temporal features in the state space to construct online vectorized HD maps. Specifically, MambaMap incorporates a memory bank to store and utilize information from historical frames, dynamically updating BEV features and instance queries to improve robustness against noise and occlusions. Moreover, we introduce a gating mechanism in the state space, selectively integrating dependencies of map elements in high computational efficiency. In addition, we design innovative multi-directional and spatial-temporal scanning strategies to enhance feature extraction at both BEV and instance levels. These strategies significantly boost the prediction accuracy of our approach while ensuring robust temporal consistency. Extensive experiments on the nuScenes and Argoverse2 datasets demonstrate that our proposed MambaMap approach outperforms state-of-the-art methods across various splits and perception ranges. Source code will be available at https://github.com/ZiziAmy/MambaMap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。