用简化3D地图实现无人机精准定位,无需复杂建模。
LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignment
- 通过神经网络预测线框与投影线框对齐来定位
- 在LoD2.0和LoD3.0地图上均超越现有方法
- 适合无纹理3D模型的无人机视觉定位场景
我们提出一种名为LoD-Loc的新方法,用于空中视觉定位。与现有算法不同,该方法不依赖复杂的3D表示,而是利用层次细节(LoD)3D地图估计无人机(UAV)位姿。核心思路是将基于LoD投影模型提取的线框与神经网络预测的线框进行对齐。给定来自UAV传感器的粗略位姿,LoD-Loc分层构建代价体积,对均匀采样的位姿假设进行概率分布建模,并选取概率最大的位姿。体积中的每项代价衡量投影线框与预测线框之间的线段对齐程度。此外,设计了一种可微分的高斯-牛顿法6-DoF位姿优化算法以精化结果。由于缺乏公开数据集,我们收集了两个包含LoD2.0和LoD3.0层级的地图数据集,搭配真实RGB查询图像和真值位姿标注。实验表明,该方法性能优异,甚至超越使用纹理3D模型的当前最先进方法。代码与数据集已公开于https://victorzoo.github.io/LoD-Loc.github.io/。
原文摘要 · Abstract (English)
We propose a new method named LoD-Loc for visual localization in the air. Unlike existing localization algorithms, LoD-Loc does not rely on complex 3D representations and can estimate the pose of an Unmanned Aerial Vehicle (UAV) using a Level-of-Detail (LoD) 3D map. LoD-Loc mainly achieves this goal by aligning the wireframe derived from the LoD projected model with that predicted by the neural network. Specifically, given a coarse pose provided by the UAV sensor, LoD-Loc hierarchically builds a cost volume for uniformly sampled pose hypotheses to describe pose probability distribution and select a pose with maximum probability. Each cost within this volume measures the degree of line alignment between projected and predicted wireframes. LoD-Loc also devises a 6-DoF pose optimization algorithm to refine the previous result with a differentiable Gaussian-Newton method. As no public dataset exists for the studied problem, we collect two datasets with map levels of LoD3.0 and LoD2.0, along with real RGB queries and ground-truth pose annotations. We benchmark our method and demonstrate that LoD-Loc achieves excellent performance, even surpassing current state-of-the-art methods that use textured 3D models for localization. The code and dataset are available at https://victorzoo.github.io/LoD-Loc.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。