用物理模型+神经网络,少碰几下就学会抓变形物体。
Learning Equivariant Neural-Augmented Object Dynamics From Few Interactions

- 结合弹簧质量物理模型与等变图网络,约束运动合理性
- 仅需少量交互数据,在仿真和机器人上准确预测动态
- 适合做柔体物体操控的算法研究者和工程师
学习高效的数据驱动物体动力学模型仍具挑战性,尤其针对可变形物体。现有方法常将物体建模为3D粒子集合,用图神经网络学习其运动,但难以长期保持物理可行性,且需大量交互数据。本文提出PIEGraph,一种融合解析物理与数据驱动模型的新方法,适用于刚体与可变形体,仅需少量真实交互数据。PIEGraph包含两部分:(1) 基于弹簧-质量系统的物理感知粒子模型,确保运动符合物理规律;(2) 具有新型动作表示的等变图神经网络,利用粒子间对称性引导模型演化。我们在绳索、布料、填充玩具和刚体的翻转与重定位任务中进行仿真与硬件实验。结果表明,该方法实现高精度动力学预测,并显著提升下游机器人操作规划性能,优于现有主流基线。
原文摘要 · Abstract (English)
Learning data-efficient object dynamics models for robotic manipulation remains challenging, especially for deformable objects. A popular approach is to model objects as sets of 3D particles and learn their motion using graph neural networks. In practice, this is not enough to maintain physical feasibility over long horizons and may require large amounts of interaction data to learn. We introduce PIEGraph, a novel approach to combining analytical physics and data-driven models to capture object dynamics for both rigid and deformable bodies using limited real-world interaction data. PIEGraph consists of two components: (1) a \textbf{P}hysically \textbf{I}nformed particle-based analytical model (implemented as a spring--mass system) to enforce physically feasible motion, and (2) an \textbf{E}quivariant \textbf{Graph} Neural Network with a novel action representation that exploits symmetries in particle interactions to guide the analytical model. We evaluate PIEGraph in simulation and on robot hardware for reorientation and repositioning tasks with ropes, cloth, stuffed animals and rigid objects. We show that our method enables accurate dynamics prediction and reliable downstream robotic manipulation planning, which outperforms state of the art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。