arXiv:2604.01994cs.CV2026-04

用频域监督让4D物理模拟更真实,仅需消费级显卡

Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation

  • 通过时空双域约束,不用密集生成视频也能精准控制运动
  • 训练内存从35GB降至20GB,单张消费级显卡可跑高保真模拟
  • 自动分割物体并优化全部材料参数,适合复杂动态场景研究

从静态3D场景生成物理驱动的4D动态模拟仍受制于一个被忽视的矛盾:可靠的运动监督常依赖在线视频扩散或光流管道,其计算成本超过模拟器本身。现有方法还通过仅优化部分材料参数简化逆物理建模,限制了复杂材质与动力学场景的真实感。我们提出Resonance4D,一个将3D高斯点云与物质点法结合的物理驱动4D动态模拟框架,采用轻量但物理意义明确的监督机制。核心洞察是:无需密集时序生成,即可通过联合约束互补域中的运动一致性来实现动态一致性。为此,我们引入双域运动监督(DMS),结合局部形变的空间结构一致性与振荡和全局动态模式的频域谱一致性,显著降低训练成本与内存开销,同时保留有意义的物理运动信号。为实现全参数稳定恢复,进一步融合零样本文本提示分割与仿真引导初始化,自动将高斯点分解为物体部件级区域,并支持全材料参数联合优化。在合成与真实场景上的实验表明,Resonance4D在保持强物理保真度与运动一致性的同时,峰值GPU内存从超过35GB降至约20GB,可在单张消费级显卡上实现高保真物理驱动4D模拟。

原文摘要 · Abstract (English)

Physics-driven 4D dynamic simulation from static 3D scenes remains constrained by an overlooked contradiction: reliable motion supervision often relies on online video diffusion or optical-flow pipelines whose computational cost exceeds that of the simulator itself. Existing methods further simplify inverse physical modeling by optimizing only partial material parameters, limiting realism in scenes with complex materials and dynamics. We present Resonance4D, a physics-driven 4D dynamic simulation framework that couples 3D Gaussian Splatting with the Material Point Method through lightweight yet physically expressive supervision. Our key insight is that dynamic consistency can be enforced without dense temporal generation by jointly constraining motion in complementary domains. To this end, we introduce Dual-domain Motion Supervision (DMS), which combines spatial structural consistency for local deformation with frequency-domain spectral consistency for oscillatory and global dynamic patterns, substantially reducing training cost and memory overhead while preserving physically meaningful motion cues. To enable stable full-parameter physical recovery, we further combine zero-shot text-prompted segmentation with simulation-guided initialization to automatically decompose Gaussians into object-part-level regions and support joint optimization of full material parameters. Experiments on both synthetic and real scenes show that Resonance4D achieves strong physical fidelity and motion consistency while reducing peak GPU memory from over 35\,GB to around 20\,GB, enabling high-fidelity physics-driven 4D simulation on a single consumer-grade GPU.

4D模拟物理建模频域监督高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。