用强化学习让机器人用布料高效覆盖3D表面,兼顾视觉与触觉反馈。
RL-Based Coverage Path Planning for Deformable Objects on 3D Surfaces
- 通过谐波UV映射简化表面状态,结合触觉特征图进行高效感知
- 在仿真中训练出的路径使总路径长度更短、覆盖面积更大
- 适合需要精准接触操作的柔性物体任务,如清洁或擦拭
当前对柔性物体的操作研究多集中于折叠衣物、处理绳索和袋子等任务,但涉及高接触密度的任务仍较薄弱。人类使用布料或海绵擦拭表面时,依赖视觉与触觉反馈,而现有算法仍面临遮挡问题,触觉感知研究也尚未成熟。表面覆盖类任务不仅需感知能力,还需精确的机器人操作。为此,我们提出一种基于强化学习的方法,利用高效且易获取的模拟器执行任务。具体地,在模拟器中训练强化学习智能体,通过谐波UV映射简化物体表面状态表示,将模拟器提供的接触反馈转换为二维特征图,并采用缩放分组卷积(SGCNN)高效提取特征,再输出低维动作空间中的指令以生成覆盖路径。实验表明,该方法在总路径长度与覆盖面积等关键指标上优于先前方法。我们在Kinova Gen3机械臂上部署路径,对躯干模型背面执行擦拭实验,验证了方法的可行性。
原文摘要 · Abstract (English)
Currently, manipulation tasks for deformable objects often focus on activities like folding clothes, handling ropes, and manipulating bags. However, research on contact-rich tasks involving deformable objects remains relatively underdeveloped. When humans use cloth or sponges to wipe surfaces, they rely on both vision and tactile feedback. Yet, current algorithms still face challenges with issues like occlusion, while research on tactile perception for manipulation is still evolving. Tasks such as covering surfaces with deformable objects demand not only perception but also precise robotic manipulation. To address this, we propose a method that leverages efficient and accessible simulators for task execution. Specifically, we train a reinforcement learning agent in a simulator to manipulate deformable objects for surface wiping tasks. We simplify the state representation of object surfaces using harmonic UV mapping, process contact feedback from the simulator on 2D feature maps, and use scaled grouped convolutions (SGCNN) to extract features efficiently. The agent then outputs actions in a reduced-dimensional action space to generate coverage paths. Experiments demonstrate that our method outperforms previous approaches in key metrics, including total path length and coverage area. We deploy these paths on a Kinova Gen3 manipulator to perform wiping experiments on the back of a torso model, validating the feasibility of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。