用流体模拟提升3D重建的物理合理性,让模型更懂物体功能。
FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction
- 通过流体-结构耦合模拟,量化表面质量不确定性
- 视觉保真度提升8.6% PSNR,流体速度发散降低62.3%
- 适合需要真实物理交互的自动驾驶与机器人场景
现实物体遵循物理规律,在与其他物体交互时表现出合理行为。但当前基于多视角2D图像的3D重建方法主要优化视觉保真度,依赖光度损失,并在图像或表示空间中推理不确定性。这种以外观为中心的方法忽略了物体接触与耦合关系,混淆了功能关键区域(如气动/水动表面)与装饰部分,即使加入物理正则化也难以实现最优重建,导致交互结果不物理、不自然。为解决此问题,本文提出FluidGaussian:一种可插拔方法,将几何重建与普遍存在的流体-结构相互作用紧密耦合,实现高粒度的表面质量评估。我们定义基于流体模拟的不确定性度量,并结合主动学习,优先选择能同时提升视觉与物理保真度的观测视角。在NeRF Synthetic (Blender)、Mip-NeRF 360和DrivAerNet++上的实证评估显示,该方法在视觉上最高提升8.6% PSNR,流体模拟中速度发散降低62.3%。代码已开源于https://github.com/delta-lab-ai/FluidGaussian。
原文摘要 · Abstract (English)
Real objects that inhabit the physical world follow physical laws and thus behave plausibly during interaction with other physical objects. However, current methods that perform 3D reconstructions of real-world scenes from multi-view 2D images optimize primarily for visual fidelity, i.e., they train with photometric losses and reason about uncertainty in the image or representation space. This appearance-centric view overlooks body contacts and couplings, conflates function-critical regions (e.g., aerodynamic or hydrodynamic surfaces) with ornamentation, and reconstructs structures suboptimally, even when physical regularizers are added. All these can lead to unphysical and implausible interactions. To address this, we consider the question: How can 3D reconstruction become aware of real-world interactions and underlying object functionality, beyond visual cues? To answer this question, we propose FluidGaussian, a plug-and-play method that tightly couples geometry reconstruction with ubiquitous fluid-structure interactions to assess surface quality at high granularity. We define a simulation-based uncertainty metric induced by fluid simulations and integrate it with active learning to prioritize views that improve both visual and physical fidelity. In an empirical evaluation on NeRF Synthetic (Blender), Mip-NeRF 360, and DrivAerNet++, our FluidGaussian method yields up to +8.6% visual PSNR (Peak Signal-to-Noise Ratio) and -62.3% velocity divergence during fluid simulations. Our code is available at https://github.com/delta-lab-ai/FluidGaussian.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。