用激光点云直接对应图像关键点,生成高精度3D参考地图提升定位准确率。
LiM-Loc: Visual Localization with Dense and Accurate 3D Reference Maps Directly Corresponding 2D Keypoints to 3D LiDAR Point Clouds
- 将2D关键点与3D激光点云直接对应,避免特征匹配误差
- 在多个数据集上显著提升相机位姿估计精度,尤其在大范围场景中
- 适合需要高精度定位的自动驾驶、机器人导航等应用
视觉定位旨在估计查询图像在3D参考地图中的6自由度相机位姿。现有方法通常从参考图像提取关键点并预先构建3D参考地图,但仅依赖图像的方案需大量图片,且特征匹配易出错,导致3D参考地图稀疏且不准确。相比之下,结合图像与3D传感器可生成更精确的地图。近年来,低成本、高密度的3D-LiDAR广泛应用,配合高精度标定相机,可获取无误差外部参数的图像。本文提出一种方法,直接将2D关键点与3D LiDAR点云对应,生成密集且高精度的3D参考地图,无需特征匹配,几乎所有关键点均可实现精准3D重建。为提升大范围定位性能,利用广域LiDAR点云剔除不可见点,减少2D-3D对应误差。在室内与室外数据集上,该方法应用于多种先进局部特征,均显著提升相机位姿估计精度。
原文摘要 · Abstract (English)
Visual localization is to estimate the 6-DOF camera pose of a query image in a 3D reference map. We extract keypoints from the reference image and generate a 3D reference map with 3D reconstruction of the keypoints in advance. We emphasize that the more keypoints in the 3D reference map and the smaller the error of the 3D positions of the keypoints, the higher the accuracy of the camera pose estimation. However, previous image-only methods require a huge number of images, and it is difficult to 3D-reconstruct keypoints without error due to inevitable mismatches and failures in feature matching. As a result, the 3D reference map is sparse and inaccurate. In contrast, accurate 3D reference maps can be generated by combining images and 3D sensors. Recently, 3D-LiDAR has been widely used around the world. LiDAR, which measures a large space with high density, has become inexpensive. In addition, accurately calibrated cameras are also widely used, so images that record the external parameters of the camera without errors can be easily obtained. In this paper, we propose a method to directly assign 3D LiDAR point clouds to keypoints to generate dense and accurate 3D reference maps. The proposed method avoids feature matching and achieves accurate 3D reconstruction for almost all keypoints. To estimate camera pose over a wide area, we use the wide-area LiDAR point cloud to remove points that are not visible to the camera and reduce 2D-3D correspondence errors. Using indoor and outdoor datasets, we apply the proposed method to several state-of-the-art local features and confirm that it improves the accuracy of camera pose estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。