用物理对齐的仿真生成高质量合成数据,让机器人学会抓取变形物体。
SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds
- 通过弹性建模和扩散轨迹生成,将少量真实演示转化为高保真合成数据
- 纯合成数据训练的策略在真实世界达90%零样本成功率,比真实数据基线提升50%泛化性
- 适合需要高效学习变形物体操作的机器人研究者,尤其关注数据稀缺场景
可变形物体的机器人操作属于数据密集型任务,其形状、接触与拓扑关系动态演化,远超刚体的复杂性。尽管仿真可缓解真实数据采集成本,现有模拟到现实的流程仍基于刚体抽象,导致几何不匹配、软体动力学脆弱,且运动策略难以适配布料交互。我们提出,仿真失败并非因其合成性,而是缺乏物理根基。为此,我们构建SIM1——一种物理对齐的真实-仿真-现实数据引擎,将有限示范数字化为度量一致的孪生场景,通过弹性建模校准可变形动力学,并结合扩散轨迹生成与质量过滤扩展行为。该流程将稀疏观测转化为具有近示范保真度的规模化合成监督信号。实验表明,仅使用合成数据训练的策略,在1:15的数据等效比下达到真实数据基线性能,真实部署中实现90%零样本成功率和50%泛化性能提升。结果验证了物理对齐仿真作为可扩展监督的有效性,为数据高效策略学习提供可行路径。
原文摘要 · Abstract (English)
Robotic manipulation with deformable objects represents a data-intensive regime in embodied learning, where shape, contact, and topology co-evolve in ways that far exceed the variability of rigids. Although simulation promises relief from the cost of real-world data acquisition, prevailing sim-to-real pipelines remain rooted in rigid-body abstractions, producing mismatched geometry, fragile soft dynamics, and motion primitives poorly suited for cloth interaction. We posit that simulation fails not for being synthetic, but for being ungrounded. To address this, we introduce SIM1, a physics-aligned real-to-sim-to-real data engine that grounds simulation in the physical world. Given limited demonstrations, the system digitizes scenes into metric-consistent twins, calibrates deformable dynamics through elastic modeling, and expands behaviors via diffusion-based trajectory generation with quality filtering. This pipeline transforms sparse observations into scaled synthetic supervision with near-demonstration fidelity. Experiments show that policies trained on purely synthetic data achieve parity with real-data baselines at a 1:15 equivalence ratio, while delivering 90% zero-shot success and 50% generalization gains in real-world deployment. These results validate physics-aligned simulation as scalable supervision for deformable manipulation and a practical pathway for data-efficient policy learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。