arXiv:2606.27364cs.CV2026-06

用世界坐标直接生成3D物体运动轨迹,无需预设物理约束。

PhysiFormer: Learning to Simulate Mechanics in World Space

论文配图:PhysiFormer: Learning to Simulate Mechanics in World Space
图 1 · 摘自论文原文
  • 将顶点轨迹预测建模为世界坐标下的单一去噪扩散过程。
  • 在10万+模拟轨迹上训练,对刚性与弹性物体均有效。
  • 适合机器人、图形学等需要几何感知和不确定性建模的场景。

我们提出PhysiFormer,一种用于生成物理合理3D物体运动的扩散Transformer。与依赖视图相关像素空间的视频世界模型不同,PhysiFormer以世界坐标系中的3D网格表示物体。给定初始顶点位置和速度,以及物体材质类型(刚性或弹性),模型可采样未来的顶点轨迹。不同于其他神经物理方法依赖特定潜在空间或显式施加刚性和因果性,PhysiFormer表明:仅通过在世界坐标中直接建模顶点轨迹预测的去噪扩散过程,即可获得优异结果。该概率框架捕捉了动态学习中的不确定性,支持从初始条件生成多样且合理的未来轨迹,适用于存在未观测不确定性的应用场景。模型采用时间、空间和物体维度分解的注意力机制,提升效率,实现无需显式对象编码的置换不变多物体推理。在超过10万条模拟轨迹上训练,PhysiFormer能生成刚性与弹性力学行为,并泛化至混合材质、未见过的真实几何形状及更多物体数量。其在轨迹精度、刚性保持和基于动量的物理一致性方面显著优于自回归基线。结果表明,坐标空间扩散是迈向视图不变、几何感知的世界建模的重要方向,适用于机器人、图形学与物理设计领域。可视化、代码与模型见https://yimingc9.github.io/physiformer。

原文摘要 · Abstract (English)

We present PhysiFormer, a diffusion transformer for physically-plausible 3D object motion. Unlike video world models that operate in view-dependent pixel space, PhysiFormer represents objects as 3D meshes expressed in world coordinates. Given the initial vertex positions and velocities, as well as object material type, rigid or elastic, the model samples future vertex trajectories. While related neural physics approaches build on ad-hoc latent spaces or explicitly enforce rigidity and causality, PhysiFormer shows that excellent results can be obtained without any such inductive biases, by casting vertex trajectory prediction as a single denoising diffusion process directly in world coordinates. The probabilistic formulation captures uncertainty in the learned dynamics, enabling diverse plausible futures from initial conditions, making this framework potentially useful for applications with unobserved uncertainty. The model features attention factorised over time, space, and objects for efficiency, enabling permutation-invariant multi-object reasoning without needing explicit object encoding. Trained on over 100k simulated trajectories, PhysiFormer generates rigid and elastic mechanics, and generalises to mixed-material settings, unseen real-world geometries, and larger object counts. It substantially outperforms autoregressive baselines in trajectory accuracy, rigidity preservation, and momentum-based physical consistency. Our results position coordinate-space diffusion as a promising step toward view-invariant, geometry-aware world modelling for robotics, graphics, and physical design. Visualisations, code, and models are available at https://yimingc9.github.io/physiformer.

物理模拟3D生成扩散模型世界模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。