arXiv:2512.16885cs.CV2025-12被引 1

从视频中估算复杂多材料物体的物理参数,提升真实交互预测能力。

M-PhyGs: Multi-Material Object Dynamics from Video

  • 用多材料物理高斯表示法,联合分割材质并恢复力学参数。
  • 在自然场景视频上实现厘米级精度的材质与动力学参数估计。
  • 适合研究物理建模、真实世界交互预测的研究者使用。

理解真实物体的动力学行为需掌握其物理材料属性。现有方法通常假设物体为均质单一材料、预设动力学模型或简化拓扑结构,难以应对现实物体复杂的材质组合与几何形态。本文以花朵为代表,提出多材料物理高斯(M-PhyGs),从自然场景下的短视频中联合分割材质并恢复其连续介质力学参数,同时考虑重力影响。M-PhyGs通过引入新型级联3D与2D损失函数,并利用时间序列小批量处理,高效完成估计。为此,我们构建了新数据集Phlowers,记录人们与花朵互动的过程,用于评估该挑战性任务的准确性。在Phlowers上的实验表明,M-PhyGs及其组件具有高精度与强有效性。

原文摘要 · Abstract (English)

Knowledge of the physical material properties governing the dynamics of a real-world object becomes necessary to accurately anticipate its response to unseen interactions. Existing methods for estimating such physical material parameters from visual data assume homogeneous single-material objects, pre-learned dynamics, or simplistic topologies. Real-world objects, however, are often complex in material composition and geometry lying outside the realm of these assumptions. In this paper, we particularly focus on flowers as a representative common object. We introduce Multi-material Physical Gaussians (M-PhyGs) to estimate the material composition and parameters of such multi-material complex natural objects from video. From a short video captured in a natural setting, M-PhyGs jointly segments the object into similar materials and recovers their continuum mechanical parameters while accounting for gravity. M-PhyGs achieves this efficiently with newly introduced cascaded 3D and 2D losses, and by leveraging temporal mini-batching. We introduce a dataset, Phlowers, of people interacting with flowers as a novel platform to evaluate the accuracy of this challenging task of multi-material physical parameter estimation. Experimental results on Phlowers dataset demonstrate the accuracy and effectiveness of M-PhyGs and its components.

物理建模视频分析多材料高斯表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。