arXiv:2603.09668cs.CV2026-03中稿 · ICLR被引 3

用物理模型从视频还原风对物体的作用,可模拟新风况下的运动。

DiffWind: Physics-Informed Differentiable Modeling of Wind-Driven Object Dynamics

  • 将风建模为网格场,物体用粒子系统表示,通过MPM模拟交互
  • 重建精度和仿真保真度显著优于现有方法,实现真实风场复现
  • 适合计算机视觉、物理模拟与影视特效领域研究者使用

从视频观测中建模风驱动的物体动态极具挑战,源于风的不可见性与时空变化性,以及物体的复杂形变。本文提出DiffWind,一种物理信息驱动的可微分框架,统一了风-物相互作用建模、基于视频的重建与前向仿真。具体地,将风表示为基于网格的物理场,物体由3D高斯泼溅生成的粒子系统表示,其交互采用材料点法(MPM)建模。为恢复风驱动的物体动态,提出联合优化时空风力场与物体运动的重建框架,结合可微渲染与仿真。为保证物理合理性,引入格子玻尔兹曼方法(LBM)作为物理约束,确保符合流体动力学定律。除重建外,本方法可自然支持在新风条件下进行前向仿真,并实现风场重定向等新应用。进一步构建了包含合成与真实场景的WD-Objects数据集。大量实验表明,该方法在重建准确率与仿真保真度上均显著优于先前动态场景建模方法,为视频驱动的风-物交互建模开辟新路径。

原文摘要 · Abstract (English)

Modeling wind-driven object dynamics from video observations is highly challenging due to the invisibility and spatio-temporal variability of wind, as well as the complex deformations of objects. We present DiffWind, a physics-informed differentiable framework that unifies wind-object interaction modeling, video-based reconstruction, and forward simulation. Specifically, we represent wind as a grid-based physical field and objects as particle systems derived from 3D Gaussian Splatting, with their interaction modeled by the Material Point Method (MPM). To recover wind-driven object dynamics, we introduce a reconstruction framework that jointly optimizes the spatio-temporal wind force field and object motion through differentiable rendering and simulation. To ensure physical validity, we incorporate the Lattice Boltzmann Method (LBM) as a physics-informed constraint, enforcing compliance with fluid dynamics laws. Beyond reconstruction, our method naturally supports forward simulation under novel wind conditions and enables new applications such as wind retargeting. We further introduce WD-Objects, a dataset of synthetic and real-world wind-driven scenes. Extensive experiments demonstrate that our method significantly outperforms prior dynamic scene modeling approaches in both reconstruction accuracy and simulation fidelity, opening a new avenue for video-based wind-object interaction modeling.

物理模拟视频重建风场建模可微分

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。