融合视觉与激光雷达,构建远距离高精度矢量地图。
SuperMapNet for Long-Range and High-Accuracy Vectorized HD Map Construction
- 用跨模态注意力和流动对齐实现视觉与点云信息紧密融合。
- 三层次交互提升元素分类与定位精度,错误率降低超14.9%。
- 适合自动驾驶地图构建,尤其长距离复杂场景应用。
矢量化高精地图对自动驾驶至关重要。现有方法存在两大问题:一是鸟瞰图特征生成中,单模态感知能力有限,多模态拼接无法捕捉模态间协同与差异,导致特征缺失、有效范围短;二是地图元素分类与定位仅依赖点信息,忽视元素间关系及点与元素的交互,造成形状错误与元素混淆。为此,本文提出SuperMapNet,融合相机图像与激光雷达点云输入。首先通过基于交叉注意力的协同增强模块与基于流的差异对齐模块,紧密耦合视觉语义与点云几何信息,生成远距离鸟瞰特征。随后,通过三级交互实现局部点特征与全局元素特征的深度融合:点-点交互学习同元素内点间几何关系,元素-元素交互建模不同元素间的约束与语义,点-元素交互为点提供互补元素信息。在nuScenes和Argoverse2数据集上实验表明,SuperMapNet在难/易设置下分别超越当前最优(SOTA)14.9/8.8 mAP和18.5/3.1 mAP。代码已公开。
原文摘要 · Abstract (English)
Vectorized HD map is essential for autonomous driving. Remarkable work has been achieved in recent years, but there are still major issues: (1) in the generation of the BEV features, single modality-based methods are of limited perception capability, while direct concatenation-based multi-modal methods fail to capture synergies and disparities between different modalities, resulting in limited ranges with feature holes; (2) in the classification and localization of map elements, only point information is used without the consideration of element infor-mation and neglects the interaction between point information and element information, leading to erroneous shapes and element entanglement with low accuracy. To address above issues, we introduce SuperMapNet for long-range and high-accuracy vectorized HD map construction. It uses both camera images and LiDAR point clouds as input, and first tightly couple semantic information from camera images and geometric information from LiDAR point clouds by a cross-attention based synergy enhancement module and a flow-based disparity alignment module for long-range BEV feature generation. And then, local features from point queries and global features from element queries are tightly coupled by three-level interactions for high-accuracy classification and localization, where Point2Point interaction learns local geometric information between points of the same element and of each point, Element2Element interaction learns relation constraints between different elements and semantic information of each elements, and Point2Element interaction learns complement element information for its constituent points. Experiments on the nuScenes and Argoverse2 datasets demonstrate superior performances, surpassing SOTAs over 14.9/8.8 mAP and 18.5/3.1 mAP under hard/easy settings, respectively. The code is made publicly available1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。