用物理约束提升可变形物体动态预测精度,支持新物体在线材料识别。
PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics

- 结合可微分物质点法与神经网络,从视觉观察推断材料弹性并修正模拟偏差。
- 在真实机器人操作数据上预测误差低于现有方法,且置信度分布可靠。
- 适合需要高精度动态模拟的机器人抓取与自主探索任务。
预测可变形物体在机器人操作下的演化过程是一个长期挑战。现有方法通常依赖逐物体优化来拟合材料参数,效率低且泛化性差;而端到端学习方法外推能力弱,常违背基本物理规律。本文提出PhysCoRe——一种物理修正的残差世界模型,将可微分物质点法(MPM)模拟器与两个前馈神经网络耦合。材料精炼模块Material from Motion(MfM)从视觉观测中推断每粒子的弹性,使模拟器具备对象特异性物理基础;残差校正模块Residual from Dynamics(RfD)学习模拟器内部动力学的偏差并预测修正项,吸收分析模型无法捕捉的系统性偏差。该设计还支持对新物体的在线材料识别:MfM可从有限交互中适应,其预测不确定性引导进一步探索至置信度最低区域。在真实可变形物体操作序列上的实验表明,PhysCoRe在预测精度上优于当前最优基线,且其预测置信度在物体几何上形成可靠分布,为未来基于置信度的探索提供自然信号。
原文摘要 · Abstract (English)
Predicting how deformable objects evolve under robotic manipulation is a longstanding challenge. Existing approaches typically rely on per-object optimization to fit material parameters, which can be slow and cannot generalize, while end-to-end learned alternatives extrapolate poorly and often violate basic physical structure. We present PhysCoRe, a physics-corrected residual world model that couples a differentiable Material Point Method (MPM) simulator with two feed-forward neural networks. A material refinement module, Material from Motion (MfM), infers per-particle elasticity from visual observations, grounding the simulator in object-specific physics. A residual correction module, Residual from Dynamics (RfD), learns the discrepancy and predicts corrections to the simulator's internal dynamics, absorbing systematic biases that the analytical model cannot capture. This design also supports online material identification on novel objects. MfM adapts from limited interactions, and its predictive uncertainty steers further exploration toward the regions where its estimate is least confident. Experiments on real deformable-object manipulation sequences show that PhysCoRe outperforms state-of-the-art baselines in prediction accuracy, and that its predicted confidence forms a reliable distribution across the object's geometry, providing a natural signal for future confidence-guided exploration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。