用普通热成像相机实现无人机在黑暗中精准定位与建图
Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3
- 用带循环结构的轻量网络从热图像提取深度,捕捉时间连续性
- 在非辐射级热成像数据上训练,误差低于0.10,比基线降低50%以上
- 适合无GPS、低光环境下的无人机自主导航,无需昂贵热成像设备
在无GPS和视觉退化环境下,无人飞行器(UAV)的自主导航仍具挑战。本文研究单目热成像相机作为独立传感器,在UAV平台上实现实时深度估计与同时定位与建图(SLAM)。为从热图像中提取深度信息,提出一种新型流水线:采用集成循环块(RBs)的轻量监督网络,以捕捉时间依赖性,提升预测鲁棒性。该网络结合轻量卷积骨干与热图像增强网络(T-RefNet),对原始热图像进行优化,增强特征可见性。经增强的热图像与预测深度图被整合进 ORB-SLAM3,实现纯热成像定位。不同于以往方法,本网络在自定义的非辐射级数据集上训练,无需高成本辐射级热成像仪。实验结果表明,在辐射级 VIVID++(室内暗光)数据集上,绝对相对误差约0.06,优于基线(>0.11);在非辐射级室内数据集上,基线误差高于0.24,本方法保持在0.10以下。纯热成像的 ORB-SLAM3 平均轨迹误差低于0.4米。
原文摘要 · Abstract (English)
Autonomous navigation in GPS-denied and visually degraded environments remains challenging for unmanned aerial vehicles (UAVs). To this end, we investigate the use of a monocular thermal camera as a standalone sensor on a UAV platform for real-time depth estimation and simultaneous localization and mapping (SLAM). To extract depth information from thermal images, we propose a novel pipeline employing a lightweight supervised network with recurrent blocks (RBs) integrated to capture temporal dependencies, enabling more robust predictions. The network combines lightweight convolutional backbones with a thermal refinement network (T-RefNet) to refine raw thermal inputs and enhance feature visibility. The refined thermal images and predicted depth maps are integrated into ORB-SLAM3, enabling thermal-only localization. Unlike previous methods, the network is trained on a custom non-radiometric dataset, obviating the need for high-cost radiometric thermal cameras. Experimental results on datasets and UAV flights demonstrate competitive depth accuracy and robust SLAM performance under low-light conditions. On the radiometric VIVID++ (indoor-dark) dataset, our method achieves an absolute relative error of approximately 0.06, compared to baselines exceeding 0.11. In our non-radiometric indoor set, baseline errors remain above 0.24, whereas our approach remains below 0.10. Thermal-only ORB-SLAM3 maintains a mean trajectory error under 0.4 m.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。