arXiv:2601.00504cs.CVcs.AI2026-01AAAI被引 1

用自然语言生成物理参数,让3D物体自动模拟真实运动

MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation

  • 通过大语言模型估算材料参数范围,结合可学习运动蒸馏损失
  • 在30多个场景中实现视觉逼真的动态模拟,优于现有方法
  • 适合想快速生成真实物理动画的创作者和研究人员

准确模拟3D物体及多种材料的动态行为通常需要专业知识和繁琐的物理参数调优。我们提出MotionPhysics,一个端到端可微分框架,仅凭用户提供的自然语言提示即可推断目标3D场景的合理物理参数,无需真实轨迹或标注视频作为指导。首先利用多模态大语言模型估计材料参数值,并约束在合理范围内;进一步提出可学习的运动蒸馏损失,从预训练视频扩散模型中提取稳健的运动先验,同时最小化外观与几何归纳偏置。我们在超过三十个场景中评估该方法,涵盖真实世界、人工设计及AI生成的3D物体,涉及弹性固体、金属、泡沫、沙粒以及牛顿与非牛顿流体等多种材料。结果表明,MotionPhysics能生成由自然语言引导的视觉上逼真的动态模拟,且自动确定物理上合理的参数,性能超越当前最先进方法。代码与项目页面见:https://wangmiaowei.github.io/MotionPhysics.github.io/

原文摘要 · Abstract (English)

Accurately simulating existing 3D objects and a wide variety of materials often demands expert knowledge and time-consuming physical parameter tuning to achieve the desired dynamic behavior. We introduce MotionPhysics, an end-to-end differentiable framework that infers plausible physical parameters from a user-provided natural language prompt for a chosen 3D scene of interest, removing the need for guidance from ground-truth trajectories or annotated videos. Our approach first utilizes a multimodal large language model to estimate material parameter values, which are constrained to lie within plausible ranges. We further propose a learnable motion distillation loss that extracts robust motion priors from pretrained video diffusion models while minimizing appearance and geometry inductive biases to guide the simulation. We evaluate MotionPhysics across more than thirty scenarios, including real-world, human-designed, and AI-generated 3D objects, spanning a wide range of materials such as elastic solids, metals, foams, sand, and both Newtonian and non-Newtonian fluids. We demonstrate that MotionPhysics produces visually realistic dynamic simulations guided by natural language, surpassing the state of the art while automatically determining physically plausible parameters. The code and project page are available at: https://wangmiaowei.github.io/MotionPhysics.github.io/.

物理模拟文本生成运动蒸馏3D动画

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。