arXiv:2508.12394cs.RO2025-08中稿 · ICRA被引 5

用强化学习让无人机看图导航,还能避障安全飞行。

SIGN: Safety-Aware Image-Goal Navigation for Autonomous Drones via Reinforcement Learning

  • 用强化学习实现无人机端到端看图导航,直接控制速度
  • 加入视觉增强和深度安全模块,实现在复杂环境稳定飞行
  • 适合做无人机自主探索与目标定位的研究者参考

图像目标导航(ImageNav)任务要求机器人在未知环境中自主探索,并到达与给定目标图像视觉匹配的位置。现有研究多聚焦地面机器人,而使无人机具备此能力更具挑战性,因其需高频反馈控制与全局定位以维持稳定飞行。本文提出一种新颖的仿真到现实框架,利用强化学习实现无人机的图像目标导航。为提升视觉表征能力,方法在训练中引入图像扰动与未来状态预测等辅助任务,显著改善策略训练效果。所提算法支持端到端导航并直接输出速度指令,无需外部定位系统。此外,集成基于深度的安全模块实现实时障碍物规避,使无人机可在密集环境中安全航行。不同于仅关注轨迹跟踪或避障的现有方法,本框架整合了自主探索、避障与图像目标搜索功能,且无需显式构建全局地图。代码与模型权重已公开于 https://github.com/Zichen-Yan/SIGN。

原文摘要 · Abstract (English)

Image-goal navigation (ImageNav) tasks a robot with autonomously exploring an unknown environment and reaching a location that visually matches a given target image. While prior works primarily study ImageNav for ground robots, enabling this capability for autonomous drones is substantially more challenging due to their need for high-frequency feedback control and global localization for stable flight. In this paper, we propose a novel sim-to-real framework that leverages reinforcement learning (RL) to achieve ImageNav for drones. To enhance visual representation ability, our approach trains the vision backbone with auxiliary tasks, including image perturbations and future transition prediction, which results in more effective policy training. The proposed algorithm enables end-to-end ImageNav with direct velocity control, eliminating the need for external localization. Furthermore, we integrate a depth-based safety module for real-time obstacle avoidance, allowing the drone to safely navigate in cluttered environments. Unlike most existing drone navigation methods that focus solely on reference tracking or obstacle avoidance, our framework supports comprehensive navigation behaviors, including autonomous exploration, obstacle avoidance, and image-goal seeking, without requiring explicit global mapping. Code and model checkpoints are available at https://github.com/Zichen-Yan/SIGN.

无人机导航强化学习视觉定位安全避障

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。