arXiv:2510.06277cs.CVcs.LG2025-10被引 1

用动态图像掩码代替位置信息,让机器人在无先验条件下也能高效完成视觉任务。

Dynamic Object Masks as Goal Representations for Visual Goal-Conditioned Reinforcement Learning

  • 用图像处理与检测器生成目标区域掩码,无需物体位置或状态信息
  • 在真实机械臂上实现99%成功率,对未见过的物体也表现良好
  • 适合缺乏先验信息的真实机器人场景,如仓储、农业等

目标条件强化学习(GCRL)提供了一种统一的方法来应对多样任务,但现有方法多依赖状态或位置型目标表示,在真实机器人环境中难以获取。在仓库、农业或实验室等场景中,机器人通常无法获得特权目标状态、物体位置或未来观测,限制了当前GCRL方法的实际应用。本文提出一种基于动态掩码的目标表示方式,为基于视觉的导航与操作提供简单、无关物体的视觉提示。每个时间步,通过标准图像处理、特定任务的物体识别器或预训练检测器(如Detic或Grounding DINO)生成目标掩码,明确空间目标而无需特权信息,具备广泛适用性与对未见物体的强大泛化能力。该方法提升了GCRL的稳定性和样本效率,在Franka和UR10e机械臂上实现了对训练及新物体99%的成功率,并在模拟导航中实现更快学习。进一步验证了从零开始训练与仿真到现实的迁移效果,证明该方法在真实强化学习任务中的有效性。代码已公开于https://github.com/fahimfss/GCRL。

原文摘要 · Abstract (English)

Goal-conditioned reinforcement learning (GCRL) offers a unified way to pursue diverse tasks, yet most existing methods rely on state- or position-based goal representations that are unavailable in real-world robotics. Robots operating in warehouses, agriculture, or laboratory environments rarely have access to privileged goal states, object positions, or future observations, limiting the practicality of current GCRL approaches. We propose a dynamic mask-based goal representation that provides simple, object-agnostic visual cues for vision-based navigation and manipulation. At each timestep, an image-based goal detector produces a goal mask using standard image processing, task-specific object recognizers, or pretrained detectors such as Detic or Grounding DINO. These masks specify the spatial target without requiring privileged goal states, enabling broad applicability and strong generalization to unseen objects. Our method improves stability and sample efficiency in GCRL, achieving a 99% success rate in reaching both training and novel objects with Franka and UR10e robotic arms and faster learning in simulated navigation. We further demonstrate learning from scratch and sim-to-real transfer on both robotic arms, highlighting the effectiveness of our approach for real-world RL tasks. Our code is available at https://github.com/fahimfss/GCRL.

强化学习视觉导航机器人目标表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。