用少量真实数据让物理模拟更准,支持机器人学习优化。
Few-Shot Neural Differentiable Simulator: Real-to-Sim Rigid-Contact Modeling
- 结合物理公式与图神经网络,仅需少量真实数据校准模拟器。
- 生成大规模合成数据,复现真实轨迹且优于现有可微模拟方法。
- 支持梯度优化,适合多物体交互场景的机器人策略学习。
准确的物理模拟对机器人学习与控制至关重要,但解析模拟器常无法捕捉复杂接触动力学,而基于学习的模拟器通常需要大量昂贵的真实世界数据。为此,我们提出一种少样本真实到模拟的方法,将解析公式的物理一致性与基于图神经网络(GNN)模型的表征能力相结合。仅使用少量真实世界数据,该方法即可校准解析模拟器,生成涵盖多样化接触交互的大规模合成数据集。在此基础上,我们引入一种基于网格的GNN,隐式建模刚体前向动力学,并推导出用于碰撞检测的代理梯度,实现完全可微。实验结果表明,该方法使基于学习的模拟器在复现真实轨迹方面优于可微基线模型。此外,可微设计支持梯度优化,我们在多物体交互场景中验证了基于模拟的策略学习效果。大量实验显示,该框架不仅以最小监督提升模拟保真度,还显著提高策略学习效率。综合来看,少样本真实数据驱动的可微模拟为未来机器人操作与控制提供了有力方向。
原文摘要 · Abstract (English)
Accurate physics simulation is essential for robotic learning and control, yet analytical simulators often fail to capture complex contact dynamics, while learning-based simulators typically require large amounts of costly real-world data. To bridge this gap, we propose a few-shot real-to-sim approach that combines the physical consistency of analytical formulations with the representational capacity of graph neural network (GNN)-based models. Using only a small amount of real-world data, our method calibrates analytical simulators to generate large-scale synthetic datasets that capture diverse contact interactions. On this foundation, we introduce a mesh-based GNN that implicitly models rigid-body forward dynamics and derive surrogate gradients for collision detection, achieving full differentiability. Experimental results demonstrate that our approach enables learning-based simulators to outperform differentiable baselines in replicating real-world trajectories. In addition, the differentiable design supports gradient-based optimization, which we validate through simulation-based policy learning in multi-object interaction scenarios. Extensive experiments show that our framework not only improves simulation fidelity with minimal supervision but also increases the efficiency of policy learning. Taken together, these findings suggest that differentiable simulation with few-shot real-world grounding provides a powerful direction for advancing future robotic manipulation and control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。