单目无人机在无卫星信号时,靠地图先验实现精准三维定位。
AeroMap3D: Anchoring Monocular UAV 6-DoF Localization to Visual-Geometric-Semantic Map Priors

- 用轻量适配器校准图像与地图的视角差异,无需微调即可匹配
- 结合地形和语义信息过滤错误匹配,3D定位误差仅5.88米
- 适合城市复杂环境下的无人机自主导航,无需重新训练
我们提出AeroMap3D,一种单目6-自由度无人机定位系统,通过将机载影像锚定于视觉、几何与语义地图先验,在无GNSS环境下实现导航。该系统解决两大核心挑战:无人机图像与卫星地图间的跨视图差异,以及裸地数字高程模型(DEMs)与城市场景之间的结构不一致。首先,引入轻量级适配器,使预训练于互联网规模通用数据的密集匹配器无需微调即可可靠完成无人机图像与地图的注册;通过估计图像与地图瓦片间的尺度比和航向偏移,消除因高度、相机视场角和航向造成的主导性几何错位。其次,将2D对应点提升至DEM地形,并利用OpenStreetMap标注剔除语义不可靠匹配,再进行RANSAC-PnP姿态估计,有效降低因未建模建筑高度和非正射结构带来的误差。延迟的地图姿态测量通过延迟状态扩展卡尔曼滤波(EKF)与相对运动先验融合,实现连续轨迹估计。无需AeroMap3D-Terra3D重训练或调参,系统在八处奥斯汀场地所有轨迹均控制在50米内,55公里飞行中平均3D误差达5.88米。
原文摘要 · Abstract (English)
We present AeroMap3D, a monocular 6-DoF UAV localization system that anchors onboard imagery to visual, geometric, and semantic map priors for GNSS-denied navigation. AeroMap3D addresses two fundamental challenges in map-referenced aerial localization: the cross-view discrepancy between UAV imagery and satellite maps, and the structural inconsistency between bare-earth digital elevation models (DEMs) and urban scenes. First, we introduce a lightweight adapter that enables a dense matcher pretrained on internet-scale generic data to perform reliable UAV-to-map registration without finetuning. By estimating the scale ratio and yaw offset between the UAV image and map tile, the adapter removes the dominant geometric misalignment induced by altitude, camera field of view, and heading before dense correspondence estimation. Second, AeroMap3D lifts 2D UAV-map correspondences onto DEM terrain while using OpenStreetMap annotations to reject semantically unreliable matches before RANSAC-PnP pose estimation, thereby reducing errors caused by unmodeled building heights and off-nadir structures. Delayed map-based pose measurements are further fused with relative-motion priors using a delayed-state EKF for continuous trajectory estimation. Without UAV-Terra3D retraining or tuning, AeroMap3D localizes all trajectories across eight Austin sites within 50 m and achieves 5.88 m mean 3D error over 55 km of flight.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。