arXiv:2605.19386cs.CV2026-05被引 1

从单视角视频中学习材料感知的物理参数,实现更一致的可变形物体仿真。

MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos

论文配图:MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos
图 1 · 摘自论文原文
  • 基于DINO特征分割物体,为不同部分分配独立材料先验。
  • 通过共享材料代码本确保同种材料在不同场景下参数一致。
  • 适合需要泛化能力的视觉、图形与机器人仿真任务。

重建可模拟的可变形物体对视觉、图形和机器人领域至关重要。现有物理驱动方法虽能从视频中恢复物理数字孪生体,但存在两大根本局限:通常假设物体整体材料均质,且依赖场景特定的逆向优化,结合单目观测的固有歧义性,导致同一材料在不同场景或交互中参数不一致。我们提出MatPhys,一种材料感知的前馈框架,可从单视角视频预测弹簧-质量模型参数,通过两项耦合设计解决上述问题。为放宽均质材料假设,利用DINO特征将物体分解为语义有意义的部分,并查询局部材料先验,为每部分分配独立物理行为。为保证跨场景一致性,引入学习型材料代码本作为外观与物理间的桥梁,并使用局部先验作为参考分布约束解码器,使相同材料在不同场景和交互中产生一致参数。这些设计将原本欠约束的单目问题转化为基于共享、可复用材料概念的前馈推理。实验表明,该方法在重建与未来预测上达到逐场景优化基线水平,同时在未见交互和物体上展现出更强泛化能力,且物理参数更一致。

原文摘要 · Abstract (English)

Reconstructing simulation-ready deformable objects is important for vision, graphics, and robotics. Existing physics-driven methods can recover physical digital twins from videos, but they suffer from two fundamental limitations: they typically assume a homogeneous material across the whole object, and their scene-specific inverse optimization, combined with the inherent ambiguity of monocular observation, yields inconsistent parameters for the same material across different scenes or interactions. We propose MatPhys, a material-aware feed-forward framework that predicts spring-mass parameters from a single-view video, addressing these two issues with two coupled designs. To relax the homogeneous material assumption, we use DINO features to decompose the object into semantically meaningful parts and to query a part-level material prior, assigning each part its own physical behavior. To enforce cross-scene consistency, we introduce a learned material codebook of shared material embeddings as the bridge between appearance and physics, and further use the part-level prior as a reference distribution that constrains the decoder so that the same material yields consistent parameters across scenes and interactions. Together, these designs turn an under-constrained monocular problem into feed-forward inference grounded on shared, reusable material concepts. Experiments show that our method matches per-scene optimization baselines in reconstruction and future prediction, while achieving stronger generalization to unseen interactions and objects with more consistent physical parameters.

物理仿真材料感知视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。