arXiv:2503.05817cs.ROcs.LG2025-03被引 9

用图神经网络学布料动态,让机器人更准地挂衣服。

GraphGarment: Learning Garment Dynamics for Bimanual Cloth Manipulation Tasks

  • 用图结构建模机械臂与布料的交互,通过GNN预测布料状态变化。
  • 仿真中预测误差比基线低0.46厘米,挂衣成功率提升10%至24%。
  • 适合作为布料操作任务的模型基础,尤其适合家庭与医疗场景。

衣物物理操作在悬挂等任务中至关重要,但布料易变形,对家用、医疗及工业机器人仍是挑战。本文提出GraphGarment,基于机器人控制输入建模布料动态。采用图神经网络(GNN)学习动力学模型,可预测给定当前状态和动作下的下一时刻布料状态。为缩小仿真到现实的差距,引入残差模型修正预测误差。该模型用于基于模型的动作采样策略,将布料调整至预挂姿态。四组实验涵盖六类衣物,在仿真与真实环境中验证。仿真中预测误差较最优基线低0.46厘米;挂衣任务成功率分别提升12%、24%、10%。真实机器人实验显示,误差仅增加0.17厘米,证明了仿真到现实的鲁棒性迁移能力。

原文摘要 · Abstract (English)

Physical manipulation of garments is often crucial when performing fabric-related tasks, such as hanging garments. However, due to the deformable nature of fabrics, these operations remain a significant challenge for robots in household, healthcare, and industrial environments. In this paper, we propose GraphGarment, a novel approach that models garment dynamics based on robot control inputs and applies the learned dynamics model to facilitate garment manipulation tasks such as hanging. Specifically, we use graphs to represent the interactions between the robot end-effector and the garment. GraphGarment uses a graph neural network (GNN) to learn a dynamics model that can predict the next garment state given the current state and input action in simulation. To address the substantial sim-to-real gap, we propose a residual model that compensates for garment state prediction errors, thereby improving real-world performance. The garment dynamics model is then applied to a model-based action sampling strategy, where it is utilized to manipulate the garment to a reference pre-hanging configuration for garment-hanging tasks. We conducted four experiments using six types of garments to validate our approach in both simulation and real-world settings. In simulation experiments, GraphGarment achieves better garment state prediction performance, with a prediction error 0.46 cm lower than the best baseline. Our approach also demonstrates improved performance in the garment-hanging simulation experiment with enhancements of 12%, 24%, and 10%, respectively. Moreover, real-world robot experiments confirm the robustness of sim-to-real transfer, with an error increase of 0.17 cm compared to simulation results. Supplementary material is available at:https://sites.google.com/view/graphgarment.

布料操控图神经网络机器人抓取模拟现实迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。