用透视关系提升地图定位精度,让车载摄像头更准识路。
HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps
- 通过鸟瞰图语义对齐构建满足单应关系的图像对,引导特征融合。
- 在nuScenes上实现0.83米平均定位误差,优于现有方法。
- 支持跨分辨率输入,适合自动驾驶高精地图实时定位场景。
在标准清晰度(SD)地图上的视觉定位已成为自动驾驶低成本、可扩展的解决方案。然而,现有基于回归的方法常忽略固有的几何先验,导致训练效率低且定位精度有限。本文提出一种新型单应性引导的姿态估计网络,用于多视角图像与标准清晰度地图之间的细粒度视觉定位。通过将地面视角特征投影至鸟瞰图(BEV)域,并与地图特征进行语义对齐,构造满足单应性约束的输入对;随后利用单应性关系引导特征融合,并将姿态输出限制在有效可行区域内,显著提升了训练效率和定位精度。相比依赖注意力融合和直接3-自由度姿态回归的方法,本方案表现更优。据我们所知,这是首个将BEV语义推理与单应性学习统一于图像到地图定位的工作。此外,显式建模单应性变换使框架天然支持跨分辨率输入,增强模型灵活性。在nuScenes数据集上的大量实验表明,本方法显著超越现有最先进视觉定位技术。代码与预训练模型将公开发布,以促进后续研究。
原文摘要 · Abstract (English)
Visual localization on standard-definition (SD) maps has emerged as a promising low-cost and scalable solution for autonomous driving. However, existing regression-based approaches often overlook inherent geometric priors, resulting in suboptimal training efficiency and limited localization accuracy. In this paper, we propose a novel homography-guided pose estimator network for fine-grained visual localization between multi-view images and standard-definition (SD) maps. We construct input pairs that satisfy a homography constraint by projecting ground-view features into the BEV domain and enforcing semantic alignment with map features. Then we leverage homography relationships to guide feature fusion and restrict the pose outputs to a valid feasible region, which significantly improves training efficiency and localization accuracy compared to prior methods relying on attention-based fusion and direct 3-DoF pose regression. To the best of our knowledge, this is the first work to unify BEV semantic reasoning with homography learning for image-to-map localization. Furthermore, by explicitly modeling homography transformations, the proposed framework naturally supports cross-resolution inputs, enhancing model flexibility. Extensive experiments on the nuScenes dataset demonstrate that our approach significantly outperforms existing state-of-the-art visual localization methods. Code and pretrained models will be publicly released to foster future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。