用GPU加速模拟软体操作,几分钟内完成高保真训练
FLASH: Fast Learning via GPU-Accelerated Simulation for High-Fidelity Deformable Manipulation in Minutes

- 基于NCP的物理引擎重构,专为GPU并行设计
- 单卡RTX 5090支持超300万自由度、30帧/秒运行
- 合成数据训练政策实现零样本真实迁移,无需实操演示
如Isaac Sim等仿真框架已实现行走和刚体操作的可扩展机器人学习;然而,接触密集型仿真仍是软体操作的主要瓶颈。软材料持续变化的几何形态,加上大量顶点和接触约束,难以兼顾高精度、高速度与稳定性,制约大规模交互式学习。我们提出FLASH,一种原生基于GPU的接触密集型软体操作仿真框架,采用精确的NCP求解器,严格满足接触与形变约束,同时专为细粒度GPU并行优化。不同于将传统SIMD求解器移植至GPU,FLASH从底层重构建造物理引擎,包含优化的碰撞处理与内存布局。结果表明,其在单张RTX 5090上可支持超过300万自由度,达到30帧/秒,同时准确模拟物理交互。仅在FLASH生成的合成数据上训练数分钟的策略,即可实现稳健的零样本仿真到现实迁移,在物理机器人上完成毛巾折叠、衣物折叠等复杂软体操作任务,无需任何真实世界示范,为劳动密集型真实数据采集提供了实用替代方案。
原文摘要 · Abstract (English)
Simulation frameworks such as Isaac Sim have enabled scalable robot learning for locomotion and rigid-body manipulation; however, contact-rich simulation remains a major bottleneck for deformable object manipulation. The continuously changing geometry of soft materials, together with large numbers of vertices and contact constraints, makes it difficult to achieve high accuracy, speed, and stability required for large-scale interactive learning. We present FLASH, a GPU-native simulation framework for contact-rich deformable manipulation, built on an accurate NCP-based solver that enforces strict contact and deformation constraints while being explicitly designed for fine-grained GPU parallelism. Rather than porting conventional single-instruction-multiple-data (SIMD) solvers to GPUs, FLASH redesigns the physics engine from the ground up to leverage modern GPU architectures, including optimized collision handling and memory layouts. As a result, FLASH scales to over 3 million degrees of freedom at 30 FPS on a single RTX 5090, while accurately simulating physical interactions. Policies trained solely on FLASH-generated synthetic data in minutes achieve robust zero-shot sim-to-real transfer, which we validate on physical robots performing challenging deformable manipulation tasks such as towel folding and garment folding, without any real-world demonstration, providing a practical alternative to labor-intensive real-world data collection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。