通过瓶颈状态与探索机制,实现低数据量下柔性物体操作的鲁棒性。
Exploration-assisted Bottleneck Transition Toward Robust and Data-efficient Deformable Object Manipulation
- 用标准化瓶颈状态替代复杂初始态,降低示范需求。
- 在感知不全时仍能操作,支持自遮挡等极端情况。
- 适合数据稀缺且环境复杂的柔性物体操控场景。
模仿学习在机器人操作中表现优异,但在分布外(OOD)状态下失效。这一问题在柔性物体操作(DOM)中尤为突出,因其可能配置近乎无穷,难以全面采集数据。现有方法多依赖大量数据或高精度感知,对DOM而言常不现实,尤其存在自遮挡等挑战。为此,我们提出新型框架ExBot,通过两大优势应对OOD问题:首先引入瓶颈状态——标准化配置作为任务起点,将OOD挑战转化为从多样初始态过渡至瓶颈状态的问题,显著减少示范需求;其次,基于可识别性划分分布外状态空间,并采用双动作原语,使ExBot可在无准确感知条件下操控不可识别状态。通过聚焦瓶颈状态示范并利用探索改变感知条件,ExBot实现数据高效与对严重分布外情形的鲁棒性。真实世界实验在绳索与布料操作中验证了其在多种分布外状态下的成功任务完成能力,包括严重自遮挡情形。
原文摘要 · Abstract (English)
Imitation learning has demonstrated impressive results in robotic manipulation but fails under out-of-distribution (OOD) states. This limitation is particularly critical in Deformable Object Manipulation (DOM), where the near-infinite possible configurations render comprehensive data collection infeasible. Although several methods address OOD states, they typically require exhaustive data or highly precise perception. Such requirements are often impractical for DOM owing to its inherent complexities, including self-occlusion. To address the OOD problem in DOM, we propose a novel framework, Exploration-assisted Bottleneck Transition for Deformable Object Manipulation (ExBot), which addresses the OOD challenge through two key advantages. First, we introduce bottleneck states, standardized configurations that serve as starting points for task execution. This enables the reconceptualization of OOD challenges as the problem of transitioning diverse initial states to these bottleneck states, significantly reducing demonstration requirements. Second, to account for imperfect perception, we partition the OOD state space based on recognizability and employ dual action primitives. This approach enables ExBot to manipulate even unrecognizable states without requiring accurate perception. By concentrating demonstrations around bottleneck states and leveraging exploration to alter perceptual conditions, ExBot achieves both data efficiency and robustness to severe OOD scenarios. Real-world experiments on rope and cloth manipulation demonstrate successful task completion from diverse OOD states, including severe self-occlusions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。