arXiv:2509.19610cs.RO2025-09中稿 · T-RO被引 2

让高自由度机器人同时规划动作与感知,提升人机环境下的安全可靠性。

Look as You Leap: Planning Simultaneous Motion and Perception for High-DOF Robots

  • 用神经代理模型估算感知质量,指导路径规划
  • 在仿真和真实机器人上均优于强化学习与轨迹优化基线
  • 适合家庭、医院等需持续感知的智能机器人

在动态环境中,机器人执行常见任务需持续主动感知。本文研究的任务涵盖目标检测、人类行为识别和人脸检测等。例如,服务机器人需在操作中持续定位物体,助人机器人则需可靠感知人脸或行为以保障交互与安全。这些任务对机器人运动施加了感知约束。然而,同时求解运动与感知任务极具挑战,因两者需求常冲突。此外,机器人需快速响应环境变化,而实时评估感知质量(如目标检测置信度)往往成本高昂或不可行。该问题在家庭、医院等以人为中心的环境中尤为关键。本文提出一种基于神经代理模型的并行感知评分引导概率图规划器(PS-PRM),用于高自由度机器人从起点到目标配置的运动规划,支持静态与动态环境中的连续感知约束。相比现有主动感知、可视性感知或基于学习的规划方法,本方法在搜索路径时联合考虑感知任务与约束。通过神经代理模型近似感知评分,融入路径规划,并利用GPU并行加速在线重规划。实验表明,该方法在仿真和真实机器人测试中均显著优于基于强化学习与轨迹优化的基线方法。

原文摘要 · Abstract (English)

Most common tasks for robots in dynamic spaces require that the environment is regularly and actively perceived. The perception task considered in this work can represent a broad range of robot perception objectives, including object detection, human activity recognition, and human face detection. For example, a service robot may need to continuously localize an object during manipulation, while an assistive robot may need to reliably perceive a human face or activity for interaction and safety. These tasks impose perception constraints on robot motion. However, solving motion and perception tasks simultaneously is challenging, as their requirements often conflict. Furthermore, robots must react quickly to environmental changes, while directly evaluating perception quality (e.g., object detection confidence) is often expensive or infeasible at runtime. This problem is especially important in human-centered environments, such as homes and hospitals, where effective perception is essential for safe operation. In this work, we address motion planning for high-degree-of-freedom (DoF) robots from a start to a goal configuration with continuous perception constraints in static and dynamic environments. Our solution is a GPU-parallelized perception-score-guided probabilistic roadmap planner with a neural surrogate model (PS-PRM). Unlike existing active perception-, visibility-aware, or learning-based planners, our work jointly considers perception tasks and constraints when searching for a motion-planning solution. Our method uses a neural surrogate model to approximate perception scores, incorporates them into roadmap planning, and leverages GPU parallelism for efficient online replanning. We demonstrate that our planner outperforms RL- and trajectory-optimization-based baselines in static and dynamic environments in simulation and real-robot experiments.

运动规划感知融合机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。