arXiv:2608.22888cs.CV2026-08

首个直接从未标定水下视频重建动态场景的前馈4D高斯点云方法

NemoSplat: Feed-Forward 4D Gaussian Splatting for Media-Aware Underwater Reconstruction

论文配图:NemoSplat: Feed-Forward 4D Gaussian Splatting for Media-Aware Underwater Reconstruction
图 1 · 摘自论文原文
  • 设计可提示的动态解耦器,分离瞬时物体并融合语义先验
  • 单次前向传播即还原清晰水下场景,精度优于现有方法23.6%
  • 适用于水下摄影、海洋观测等动态复杂环境重建

在无约束水下环境中进行逼真场景重建仍面临严重介质引起的光散射与不可预测动态物体的挑战。尽管前馈视觉基础模型在泛化新视角合成与追踪方面表现卓越,但直接应用于水下视频时,光学衰减与运动干扰会致命破坏特征聚合,导致严重追踪与重建失败。为此,我们提出NemoSplat,首个面向媒体感知的动态重建的前馈4D高斯点云框架,直接处理未标定海视频。该方法不仅能稳健估计相机位姿与稠密场景深度,还设计了可提示的动态解耦器,通过置信度感知融合学习到的动态概率与可选语义文本先验,有效分离大量瞬时实体。此外,为对抗视觉退化,构建了媒体感知高斯预测器,联合估计三维高斯属性与物理介质参数,实现单次前向传播下的纯净场景还原。同时,我们引入大规模含丰富动态元素的水下数据集以支持训练与评估。在该数据集上的大量实验表明,NemoSplat在追踪精度和渲染保真度上均达到当前最优水平。

原文摘要 · Abstract (English)

Reconstructing photorealistic scenes in unconstrained underwater environments remains challenging due to severe media-induced light scattering and unpredictable dynamic objects. Recent feed-forward visual foundation models have demonstrated remarkable capabilities in generalized novel view synthesis and tracking. However, when directly applied to aquatic videos, optical attenuation and motion interference fatally corrupt their feature aggregation, leading to severe tracking and reconstruction failures. To overcome these limitations, we present NemoSplat, the first feed-forward 4D Gaussian Splatting framework tailored for media-aware dynamic reconstruction directly from uncalibrated marine videos. Beyond providing robust estimations of camera poses and dense scene depth, we devise a Promptable Dynamic Disentangler that utilizes a confidence-aware fusion strategy of learned dynamic probabilities and optional semantic text priors, effectively isolating massive transient entities. Furthermore, to counteract visual degradation, a Media-Aware Gaussian Predictor is formulated to jointly estimate intrinsic 3D Gaussian attributes alongside physical media parameters, rendering pristine scene appearance in a single forward pass. Additionally, we introduce a large-scale underwater dataset with massive dynamic elements to facilitate training and evaluation. Extensive experiments on our dataset demonstrate that NemoSplat achieves state-of-the-art tracking accuracy and high-fidelity rendering. Homepage: https://nemosplat.hkustvgd.com

4D重建水下视觉高斯点云动态解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。