用扩散模型修复嘈杂GPS,实现无需高精地图的亚米级定位。
DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoising
- 将定位问题转为基于视觉和地图条件的GPS去噪任务。
- 在多数据集上达到亚米级精度,超越现有基于鸟瞰图匹配的方法。
- 首次证明扩散模型可作为可扩展定位的生成先验,适合自动驾驶场景。
精准的视觉定位对自动驾驶至关重要,但现有方法面临根本矛盾:高精地图虽提供高精度参考,其高昂的构建与维护成本限制了可扩展性,促使研究转向如OpenStreetMap等标准地图。当前基于标准地图的方法主要聚焦于图像与地图间的鸟瞰图(BEV)匹配,忽略了普遍存在的噪声GPS信号。尽管GPS易于获取,但在城市环境中易受多路径误差影响。本文提出DiffVL,首个将视觉定位重构为基于扩散模型的GPS去噪任务的框架。核心思想是:当结合视觉BEV特征与标准地图时,嘈杂的GPS轨迹隐式编码真实位姿分布,可通过迭代扩散反演恢复。与以往基于BEV匹配(如OrienterNet)或基于Transformer的注册方法不同,DiffVL通过联合建模GPS、标准地图与视觉信号,学习逆向去噪过程,无需依赖高精地图即可实现亚米级精度。在多个数据集上的实验表明,该方法优于现有基于鸟瞰图匹配的基线。关键在于,本工作证明扩散模型可通过将噪声GPS视为生成先验,实现可扩展定位,标志着从传统匹配方法的根本性范式转变。
原文摘要 · Abstract (English)
Accurate visual localization is crucial for autonomous driving, yet existing methods face a fundamental dilemma: While high-definition (HD) maps provide high-precision localization references, their costly construction and maintenance hinder scalability, which drives research toward standard-definition (SD) maps like OpenStreetMap. Current SD-map-based approaches primarily focus on Bird's-Eye View (BEV) matching between images and maps, overlooking a ubiquitous signal-noisy GPS. Although GPS is readily available, it suffers from multipath errors in urban environments. We propose DiffVL, the first framework to reformulate visual localization as a GPS denoising task using diffusion models. Our key insight is that noisy GPS trajectory, when conditioned on visual BEV features and SD maps, implicitly encode the true pose distribution, which can be recovered through iterative diffusion refinement. DiffVL, unlike prior BEV-matching methods (e.g., OrienterNet) or transformer-based registration approaches, learns to reverse GPS noise perturbations by jointly modeling GPS, SD map, and visual signals, achieving sub-meter accuracy without relying on HD maps. Experiments on multiple datasets demonstrate that our method achieves state-of-the-art accuracy compared to BEV-matching baselines. Crucially, our work proves that diffusion models can enable scalable localization by treating noisy GPS as a generative prior-making a paradigm shift from traditional matching-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。