ForestVO通过森林专用特征匹配,让机器人在密林中更准更快定位。
ForestVO: Enhancing Visual Odometry in Forest Environments through ForestGlue
- 用合成森林数据训练特征匹配器,提升复杂环境下的对应精度。
- 仅需25%关键点(512个)就达到0.745的评估分数,计算量大幅降低。
- 适合资源受限设备实时部署,尤其适用于动态森林场景的导航系统。
视觉里程计在复杂环境如森林中仍面临挑战,如茂密植被、光照变化和重复纹理导致特征匹配不准。为此,我们提出ForestGlue,通过灰度、RGB、RGB-D和立体视觉四种配置优化SuperPoint特征检测器,并采用在合成森林数据上重训练的LightGlue或SuperGlue进行匹配。ForestGlue在仅使用512个关键点(仅为基线2048的25%)时,即可在10°阈值下达到LO-RANSAC AUC 0.745,显著降低计算开销。结合基于Transformer的位姿估计模型,构建ForestVO,利用帧间匹配的2D像素坐标估计相对相机位姿。在挑战性的TartanAir森林序列上,ForestVO平均相对位姿误差(RPE)为1.09米,kitti_score达2.33%,较DSO等直接法在动态场景中提升40%。尽管仅用10%数据训练,其性能仍媲美TartanVO,且模型更轻量。本工作建立了一个专为森林环境设计的端到端深度学习流水线,利用森林特化数据优化特征对应与位姿估计,显著提升自主导航的准确性和鲁棒性。
原文摘要 · Abstract (English)
Recent advancements in visual odometry systems have improved autonomous navigation; however, challenges persist in complex environments like forests, where dense foliage, variable lighting, and repetitive textures compromise feature correspondence accuracy. To address these challenges, we introduce ForestGlue, enhancing the SuperPoint feature detector through four configurations - grayscale, RGB, RGB-D, and stereo-vision - optimised for various sensing modalities. For feature matching, we employ LightGlue or SuperGlue, retrained with synthetic forest data. ForestGlue achieves comparable pose estimation accuracy to baseline models but requires only 512 keypoints - just 25% of the baseline's 2048 - to reach an LO-RANSAC AUC score of 0.745 at a 10° threshold. With only a quarter of keypoints needed, ForestGlue significantly reduces computational overhead, demonstrating effectiveness in dynamic forest environments, and making it suitable for real-time deployment on resource-constrained platforms. By combining ForestGlue with a transformer-based pose estimation model, we propose ForestVO, which estimates relative camera poses using matched 2D pixel coordinates between frames. On challenging TartanAir forest sequences, ForestVO achieves an average relative pose error (RPE) of 1.09 m and a kitti_score of 2.33%, outperforming direct-based methods like DSO by 40% in dynamic scenes. Despite using only 10% of the dataset for training, ForestVO maintains competitive performance with TartanVO while being a significantly lighter model. This work establishes an end-to-end deep learning pipeline specifically tailored for visual odometry in forested environments, leveraging forest-specific training data to optimise feature correspondence and pose estimation, thereby enhancing the accuracy and robustness of autonomous navigation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。