arXiv:2609.07532cs.RO2026-09

从视频中学习真实变形物体的物理规律,让机器人更懂物体如何变形。

PhysReal: Learning Real-World Deformable Object Physics via Hybrid Constitutive Modeling

论文配图:PhysReal: Learning Real-World Deformable Object Physics via Hybrid Constitutive Modeling
图 1 · 摘自论文原文
  • 用混合模型结合解析公式与神经网络,模拟材料局部差异。
  • 在多种物体交互场景中,动态重建和未来状态预测表现最优。
  • 适合做机器人抓取、交互等需要理解物理行为的任务。

从视觉观测中学习物理上合理的动态是构建交互式世界模型和具身智能体的关键。然而,真实世界中变形物体的动力学因材料响应的空间异质性而难以建模。为此,我们提出 PhysReal,一个基于视频驱动的框架,用于学习和模拟真实变形物体的底层物理机制。PhysReal 将空间可变的混合专家-神经本构模型与可微分的 MPM 模拟器及 3DGS 渲染器结合。解析专家模型提供可解释的物理先验,神经本构残差捕捉超出预设公式的材料响应。空间分布的块状结构参数化本构场,实现局部材料变化的连续表示。为从稀疏视觉观测中识别该模型,我们采用渐进课程策略,依次优化全局材料属性、空间变化的局部参数以及神经本构残差,并辅以运动和掩码监督。在多种变形物体交互的实验中,PhysReal 在动态重建和未来状态预测方面表现优异,展现出在下游机器人应用中的巨大潜力。

原文摘要 · Abstract (English)

Learning physically plausible dynamics from visual observations is essential for interactive world models and embodied agents. However, modeling real-world deformable objects remains challenging because their dynamics often arise from complex, spatially heterogeneous material responses. To address this challenge, we propose PhysReal, a video-driven framework for learning and simulating the underlying physics of real deformable objects. PhysReal integrates a spatially varying hybrid expert-neural constitutive model with a differentiable MPM simulator and 3DGS renderer. Analytical expert models provide interpretable physical priors, while neural constitutive residuals capture material responses beyond predefined formulations. Spatially distributed patches parameterize the constitutive field, enabling a continuous representation of local material variations. To organize the identification of this model from sparse visual observations, we adopt a progressive curriculum that sequentially optimizes global material properties, spatially varying local parameters, and neural constitutive residuals, together with complementary motion and mask supervision. Extensive experiments on diverse deformable-object interactions demonstrate that PhysReal achieves superior performance in dynamic reconstruction and future-state prediction, while showing strong potential for downstream robotic applications.

物理模拟变形物体机器人视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。