让机器人看得到再行动,用强化学习实现高效视觉检查。
Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection
- 以目标可见性为核心目标,训练机器人找最短可视路径。
- 在仿真中训练,部署后真实机器人仍表现更优。
- 无需地图,适合复杂环境下的自主巡检任务。
自主巡检是机器人领域的重要问题,涵盖工业监控到搜救等应用。传统方法将巡检简化为导航任务,仅关注到达指定位置并避障,但忽略了真实场景中目标在抵达精确坐标前就可能已被看见这一关键事实。真正重要的是将机器人置于能观测到目标的视角,而非仅仅到达位置。本文从感知意识出发,提出一种端到端强化学习框架,将目标可见性作为核心优化目标,使机器人能在无地图条件下找到保证视觉接触的最短路径。所学策略融合感知与本体感觉信息,完全在仿真中训练后部署至真实机器人。我们还开发了计算最优巡检路径的算法,用于评估基准。大量实验表明,该方法在模拟与真实环境中均优于经典及现有学习型导航方法,显著提升巡检效率。
原文摘要 · Abstract (English)
Autonomous inspection is a central problem in robotics, with applications ranging from industrial monitoring to search-and-rescue. Traditionally, inspection has often been reduced to navigation tasks, where the objective is to reach a predefined location while avoiding obstacles. However, this formulation captures only part of the real inspection problem. In real-world environments, the inspection targets may become visible well before their exact coordinates are reached, making further movement both redundant and inefficient. What matters more for inspection is not simply arriving at the target's position, but positioning the robot at a viewpoint from which the target becomes observable. In this work, we revisit inspection from a perception-aware perspective. We propose an end-to-end reinforcement learning framework that explicitly incorporates target visibility as the primary objective, enabling the robot to find the shortest trajectory that guarantees visual contact with the target without relying on a map. The learned policy leverages both perceptual and proprioceptive sensing and is trained entirely in simulation, before being deployed to a real-world robot. We further develop an algorithm to compute ground-truth shortest inspection paths, which provides a reference for evaluation. Through extensive experiments, we show that our method outperforms existing classical and learning-based navigation approaches, yielding more efficient inspection trajectories in both simulated and real-world settings. The project is avialable at https://sight-over-site.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。