用Transformer实现无需网格的刚体动力学建模,支持点云输入和大规模物体模拟。
RigidFormer: Learning Rigid Dynamics using Transformers

- 基于对象级Transformer,通过锚点聚合局部几何信息,避免顶点级交互
- 在标准基准上性能超越或媲美网格方法,支持200+物体且推理更快
- 适用于点云输入、分辨率泛化,适合机器人控制等需高保真动力学场景
基于学习的多物体刚体动力学仿真仍面临挑战,因接触具有不连续性且误差随时间累积。现有方法多依赖网格连接与顶点级消息传递,限制了对点云等无网格输入的应用,并导致计算成本高昂。我们提出RigidFormer,一种基于Transformer的物体中心模型,可从无网格表示中学习刚体动力学,支持可控积分步长。该模型在物体层面进行推理,通过紧凑锚点推进各物体;锚点-顶点池化将局部顶点特征融入锚点,保留接触相关几何信息而无需密集交互。我们设计锚点式旋转位置编码(Anchor-based RoPE),在保持对象与锚点无序性的前提下注入几何信息:对象令牌处理具备置换等变性,平均池化锚点描述符对锚点重编号保持不变,同时保留形状尺度。RigidFormer进一步通过可微分Kabsch对齐将更新投影至刚体流形,强制刚性约束。在标准基准上,RigidFormer使用点输入的表现优于或媲美网格基基线,运行速度更快,能泛化至未见过的点云分辨率及跨数据集,支持200+物体;我们还初步扩展至命令驱动的铰接体,将身体部件视为交互的对象级组件。
原文摘要 · Abstract (English)
Learning-based simulation of multi-object rigid-body dynamics remains difficult because contact is discontinuous and errors compound over long horizons. Most existing methods remain tied to mesh connectivity and vertex-level message passing, which limits their applicability to mesh-free inputs such as point clouds and leads to high computational cost. Efficiently modeling high-fidelity rigid-body dynamics from mesh-free representations, therefore, remains challenging. We introduce RigidFormer, an object-centric Transformer-based model that learns mesh-free rigid-body dynamics with controllable integration step sizes. RigidFormer reasons at the object level and advances each object through compact anchors; Anchor-Vertex Pooling enriches these anchors with local vertex features, retaining contact-relevant geometry without dense vertex-level interaction. We propose Anchor-based RoPE to inject anchor geometry into attention while respecting the unordered nature of objects and anchors: object-token processing is permutation-equivariant, and the mean-pooled anchor descriptor is invariant to anchor reindexing while preserving shape extent. RigidFormer further enforces rigidity by projecting updates onto the rigid-body manifold using differentiable Kabsch alignment. On standard benchmarks, RigidFormer outperforms or matches mesh-based baselines using point inputs, runs faster, generalizes to unseen point resolutions and across datasets, and scales to 200+ objects; we also show a preliminary extension to command-conditioned articulated bodies by treating body parts as interacting object-level components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。