用卫星图提升自动驾驶高精地图实时构建精度与鲁棒性
SATMapTR: Satellite Image Enhanced Online HD Map Construction
- 融合卫星图与车载感知数据,通过门控细化和几何感知融合提升特征质量
- 在nuScenes上达到73.8 mAP,较现有方法提升14.2 mAP,恶劣天气下更稳定
- 适合需要长距离、高鲁棒性地图构建的自动驾驶系统研发者
高精地图正从预标注向实时构建演进,以更好支持多样场景下的自动驾驶。但受限于车载传感器能力不足与频繁遮挡,输入数据质量差,导致地图不完整、噪声多或缺失,影响精度与鲁棒性。近期研究引入卫星图像作为辅助,提供稳定宽域视角,弥补车载视角局限。然而,鸟瞰卫星图常受植被和建筑阴影与遮挡影响而退化。现有基于基础特征提取与融合的方法效果有限。为此,本文提出SATMapTR,一种新型在线地图构建模型,通过两个关键组件有效融合卫星图像:(1) 门控特征精炼模块,结合高层语义与低层结构线索,自适应过滤卫星特征,提取高信噪比的地图相关表征;(2) 几何感知融合模块,在网格对网格层面一致融合卫星与前视图特征,减少无关区域与低质输入干扰。在nuScenes数据集上的实验表明,SATMapTR达到73.8的最高平均精度(mAP),优于当前最先进卫星增强模型达14.2 mAP。在恶劣天气与传感器故障下,其mAP下降更小,且在扩展感知范围内实现近3倍的mAP提升。
原文摘要 · Abstract (English)
High-definition (HD) maps are evolving from pre-annotated to real-time construction to better support autonomous driving in diverse scenarios. However, this process is hindered by low-quality input data caused by onboard sensors limited capability and frequent occlusions, leading to incomplete, noisy, or missing data, and thus reduced mapping accuracy and robustness. Recent efforts have introduced satellite images as auxiliary input, offering a stable, wide-area view to complement the limited ego perspective. However, satellite images in Bird's Eye View are often degraded by shadows and occlusions from vegetation and buildings. Prior methods using basic feature extraction and fusion remain ineffective. To address these challenges, we propose SATMapTR, a novel online map construction model that effectively fuses satellite image through two key components: (1) a gated feature refinement module that adaptively filters satellite image features by integrating high-level semantics with low-level structural cues to extract high signal-to-noise ratio map-relevant representations; and (2) a geometry-aware fusion module that consistently fuse satellite and BEV features at a grid-to-grid level, minimizing interference from irrelevant regions and low-quality inputs. Experimental results on the nuScenes dataset show that SATMapTR achieves the highest mean average precision (mAP) of 73.8, outperforming state-of-the-art satellite-enhanced models by up to 14.2 mAP. It also shows lower mAP degradation under adverse weather and sensor failures, and achieves nearly 3 times higher mAP at extended perception ranges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。