arXiv:2511.08310cs.CV2025-11AAAI被引 4

用神经弹簧场从视频重建并模拟变形物体,提升预测准确性。

NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos

  • 基于弹簧-质量模型,用分段拓扑建模多区域连接关系。
  • 通过神经网络表示弹簧属性,使当前状态与未来预测性能分别提升20%和25%。
  • 适合需要高保真物理模拟的数字孪生、动画生成场景。

本文旨在从视频中创建可交互变形物体的物理数字孪生。现有方法侧重于当前状态的物理学习,但对未来预测泛化能力差,因其忽略了变形体的内在物理特性,导致当前状态建模中物理学习有限。为此,我们提出NeuSpring:一种用于从视频中重建与模拟变形物体的神经弹簧场。该方法基于弹簧-质量模型实现真实物理仿真,包含两项核心创新:1)采用零阶优化的分段拓扑方案,高效建模多区域弹簧连接结构,考虑真实物体的材料异质性;2)设计基于规范坐标神经网络的神经弹簧场,跨帧表示弹簧物理属性,有效利用弹簧的空间关联性以增强物理学习。在真实世界数据集上的实验表明,NeuSpring在当前状态建模与未来预测方面均取得更优性能,对应Chamfer距离分别降低20%和25%。

原文摘要 · Abstract (English)

In this paper, we aim to create physical digital twins of deformable objects under interaction. Existing methods focus more on the physical learning of current state modeling, but generalize worse to future prediction. This is because existing methods ignore the intrinsic physical properties of deformable objects, resulting in the limited physical learning in the current state modeling. To address this, we present NeuSpring, a neural spring field for the reconstruction and simulation of deformable objects from videos. Built upon spring-mass models for realistic physical simulation, our method consists of two major innovations: 1) a piecewise topology solution that efficiently models multi-region spring connection topologies using zero-order optimization, which considers the material heterogeneity of real-world objects. 2) a neural spring field that represents spring physical properties across different frames using a canonical coordinate-based neural network, which effectively leverages the spatial associativity of springs for physical learning. Experiments on real-world datasets demonstrate that our NeuSping achieves superior reconstruction and simulation performance for current state modeling and future prediction, with Chamfer distance improved by 20% and 25%, respectively.

物理模拟数字孪生变形体视频重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。