用红外相机和结构光实现无人机在无光环境下的自主导航
AsterNav: Autonomous Aerial Robot Navigation In Darkness Using Passive Computation
- 结合红外单目相机与大孔径编码镜头,利用深度相关的散焦特征获取深度信息
- 模型在仿真中训练后直接部署于真实无人机,20赫兹运行,95.5%成功穿越复杂黑暗障碍物
- 无需外部定位系统,对光源位置和图案变化鲁棒,适合灾后救援场景
绝对黑暗中的自主空中导航对灾后搜救至关重要,但资源受限的小型飞行机器人常因缺乏光照而无法安全导航。本文提出AsterNav,通过集成红外单目相机与大孔径编码镜头及结构光,实现无需GPS或动作捕捉等外部基础设施的自主导航。该方法利用结构光点在不同深度呈现的图案差异,作为深度先验,输入至AsterNet深度估计网络。该网络基于简单光学模型在仿真中训练,无需微调即可直接部署至真实世界,可在NVIDIA Jetson Orin™ Nano上以20赫兹实时运行。模型对结构光图案变化及发射器与相机相对位置不敏感,大幅降低硬件部署成本。我们在多种真实场景中验证了该方案,包括黑暗哑光障碍物和直径6.25mm的细绳,整体成功率高达95.5%,且对象形状、位置与材质未知。据我们所知,这是首个基于单目结构光的四旋翼无人机在绝对黑暗中的导航工作。
原文摘要 · Abstract (English)
Autonomous aerial navigation in absolute darkness is crucial for post-disaster search and rescue operations, which often occur from disaster-zone power outages. Yet, due to resource constraints, tiny aerial robots, perfectly suited for these operations, are unable to navigate in the darkness to find survivors safely. In this paper, we present an autonomous aerial robot for navigation in the dark by combining an Infra-Red (IR) monocular camera with a large-aperture coded lens and structured light without external infrastructure like GPS or motion-capture. Our approach obtains depth-dependent defocus cues (each structured light point appears as a pattern that is depth dependent), which acts as a strong prior for our AsterNet deep depth estimation model. The model is trained in simulation by generating data using a simple optical model and transfers directly to the real world without any fine-tuning or retraining. AsterNet runs onboard the robot at 20 Hz on an NVIDIA Jetson Orin$^\text{TM}$ Nano. Furthermore, our network is robust to changes in the structured light pattern and relative placement of the pattern emitter and IR camera, leading to simplified and cost-effective construction. We successfully evaluate and demonstrate our proposed depth navigation approach AsterNav using depth from AsterNet in many real-world experiments using only onboard sensing and computation, including dark matte obstacles and thin ropes (diameter 6.25mm), achieving an overall success rate of 95.5% with unknown object shapes, locations and materials. To the best of our knowledge, this is the first work on monocular, structured-light-based quadrotor navigation in absolute darkness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。