arXiv:2606.15015cs.CVcs.AI2026-06被引 1

用能量场建模复杂接触下的3D物体动态,更真实且可控制。

NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics

论文配图:NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics
图 1 · 摘自论文原文
  • 以能量和耗散项定义运动,而非直接预测状态
  • 在长时序下比现有方法更准确,支持多种物理效应组合
  • 适合需要高物理真实感的视频生成与模拟任务

基于物理的视频生成需要可控且在接触、变形和外力作用下仍保持一致的3D物体动力学。现有基于轨迹的方法常仅建模单一物理效应,难以在复杂接触场景中组合保守与非保守动力学。我们提出NEXUS,一种面向接触丰富场景的3D物体动力学神经能量场框架。NEXUS将每个物体表示为结构图,并构建物体-物体与物体-环境接触图。受哈密顿神经网络启发,其通过标量能量与耗散项描述运动,而非直接预测状态或加速度。保守效应(如重力、弹性变形)作为叠加能量项,非保守效应(如阻尼、碰撞能量损失)则通过学习的瑞利型耗散建模。力由能量与耗散函数的微分导出,并使用多子步半隐式积分器进行演算。在多个受控轨迹基准测试中,NEXUS在不同机械属性与物理效应组合下,长期轨迹精度优于代表性学习与物理结构化动力学基线。进一步实验表明,NEXUS轨迹能有效指导接触丰富的视频生成,在保持良好视觉质量的同时显著提升物理合理性。

原文摘要 · Abstract (English)

Physics-grounded video generation requires controllable 3D object dynamics that remain physically consistent under contact, deformation, and external forcing. Existing trajectory-based methods often model isolated physical effects, making it difficult to compose conservative and non-conservative dynamics in contact-rich 3D scenes. We present NEXUS, a neural energy-field framework for contact-rich 3D object dynamics. NEXUS represents each object as a structural graph and constructs dynamic object-object and object-environment contact graphs. Inspired by Hamiltonian Neural Networks, NEXUS formulates motion through scalar energy and dissipation terms rather than directly predicting states or accelerations. Conservative effects, including gravity and elastic deformation, are composed as additive energy terms, while non-conservative effects such as damping and impact-induced energy loss are modeled with learned Rayleigh-style dissipation. Forces are derived by differentiating the energy and dissipation functions and rolled out with a multi-substep semi-implicit integrator. Across controlled trajectory benchmarks, NEXUS improves long-horizon accuracy over representative learned and physics-structured dynamics baselines under varying mechanical properties and physical-effect compositions. We further show that NEXUS trajectories provide effective guidance for contact-rich video generation, improving physical plausibility while maintaining competitive visual quality.

物理模拟能量场3D动态视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。