arXiv:2502.18423cs.RO2025-02中稿 · IROS 2026被引 12

让机械手高效清理杂乱环境中的被遮挡物体

RetrDex: Efficient Object Retrieval in Cluttered Scenes with a Dexterous Hand

  • 用空间感知表示学习多种清理动作(推、搅、戳)
  • 在16种常见物品上实现高成功率且可泛化到未见目标
  • 零样本迁移至真实多指机械手,实用性突出

从杂乱环境中获取被遮挡的物体既具挑战性又耗时,因复杂的支撑关系使操作尤为困难。现有方法或关注支撑关系并依赖顺序抓取移除遮挡物,或执行推挤等预处理动作以辅助后续抓取,但这些方式通常效率低下,且将物理交互视为孤立的辅助步骤。本文提出RetrDex,一种针对灵巧臂-手系统的高效物体检索框架。该方法在多样化杂乱场景中采用大规模并行强化学习,并引入空间感知表征,编码目标、灵巧手与周围杂物间的遮挡模式与空间关系。该表征使策略能发展出多样化的操作技能(如推、搅、戳),主动清除遮挡物。我们在16种家用物品上评估了RetrDex,在不同杂乱配置下均取得优异的检索性能与效率,且对未见过的目标具有强泛化能力。进一步验证了其在真实世界灵巧多指机器人系统上的零样本迁移成功,证明了方法的实际应用价值。视频详见项目网站:https://RetrDex.github.io。

原文摘要 · Abstract (English)

Retrieving objects buried beneath clutter is both challenging and time-consuming, as complex support relationships make manipulation particularly difficult. Existing methods either focus on support relations and rely on sequential grasping to remove occluding objects, or perform preparatory actions such as pushing to facilitate subsequent grasps. However, these approaches are often inefficient and treat physical interactions as isolated auxiliary steps. In this paper, we propose RetrDex, an efficient framework for dexterous arm-hand systems to learn object retrieval in cluttered scenes. Our approach leverages large-scale parallel reinforcement learning (RL) in diverse cluttered scenes and incorporates a spatially aware representation that encodes occlusion patterns and spatial relationships among the target, the dexterous hand, and surrounding clutter. This representation enables the policy to develop diverse manipulation skills (e.g., pushing, stirring, and poking) that actively clear occluders. We evaluate RetrDex on 16 household objects across varied clutter configurations, and obtain strong retrieval performance and efficiency on both seen and unseen targets. Furthermore, we demonstrate successful zero-shot transfer to a real-world dexterous multi-fingered robot system, validating the practical applicability of our method. Videos can be found on our project website: https://RetrDex.github.io.

物体检索灵巧操作强化学习零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。