提出DRAPER框架,让布料抓取模型在真实世界可靠对比测试。
DRAPER: Towards a Robust Robot Deployment and Reliable Evaluation for Quasi-Static Pick-and-Place Cloth-Shaping Neural Controllers
- 用真实抓取误差数据修正仿真环境,贴近现实抓取场景。
- 结合视觉处理与镊子夹爪,实现对多种布料的稳定抓取。
- 支持不同模型和机器人平台,适合布料操作研究者参考。
在真实环境中比较机器人布料操作系统极具挑战性。仿真训练的布料神经控制器与实际运行之间存在保真度差距,阻碍了这些方法在物理实验中的可靠部署。不同方法间实验设置不一致和硬件限制也妨碍了客观评估。本研究通过DRAPER框架,在不同材质、尺寸和颜色的布料上,对多种仿真训练的神经控制器在平整化与折叠任务中进行了可靠的现实对比。该框架通过在仿真中引入真实抓取误差(如误抓、多层抓取),生成贴近真实抓取轨迹的数据;采用特殊视觉处理技术缩小仿真到现实的感知差距;并借助镊子扩展夹爪与特定抓取流程实现稳健抓取。实验表明,DRAPER可泛化应用于不同深度学习方法与机器人平台,为布料操作研究社区提供了宝贵洞见。
原文摘要 · Abstract (English)
Comparing robotic cloth-manipulation systems in a real-world setup is challenging. The fidelity gap between simulation-trained cloth neural controllers and real-world operation hinders the reliable deployment of these methods in physical trials. Inconsistent experimental setups and hardware limitations among different approaches obstruct objective evaluations. This study demonstrates a reliable real-world comparison of different simulation-trained neural controllers on both flattening and folding tasks with different types of fabrics varying in material, size, and colour. We introduce the DRAPER framework to enable this comprehensive study, which reliably reflects the true capabilities of these neural controllers. It specifically addresses real-world grasping errors, such as misgrasping and multilayer grasping, through real-world adaptations of the simulation environment to provide data trajectories that closely reflect real-world grasping scenarios. It also employs a special set of vision processing techniques to close the simulation-to-reality gap in the perception. Furthermore, it achieves robust grasping by adopting a tweezer-extended gripper and a grasping procedure. We demonstrate DRAPER's generalisability across different deep-learning methods and robotic platforms, offering valuable insights to the cloth manipulation research community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。