arXiv:2501.03659cs.CV2025-01AAAI被引 6

用3D高斯点云重建无雾场景,直接从多视角雾霾图中恢复清晰视图。

DehazeGS: Seeing Through Fog with 3D Gaussian Splatting

  • 基于物理散射模型,将透射函数映射到高斯点上建模雾霾形成过程。
  • 在真实与合成数据集上达到当前最优去雾效果,细节还原更清晰。
  • 适合需要高效重建高质量无雾图像的自动驾驶、遥感等应用。

现有新视角合成方法通常针对高质量干净图像设计,但在雾天场景中,光的散射与衰减会严重降低渲染质量。尽管已有基于NeRF的去雾方法,但其依赖深度全连接网络和每射线采样策略,计算开销大;且隐式表征难以恢复雾中图像的细粒度细节。为此,我们提出学习显式高斯表示,通过物理前向渲染过程解释雾天图像的生成机制。本方法DehazeGS仅需多视角雾天图像作为输入,即可重建并渲染无雾场景。具体地,基于大气散射模型,通过深度到透射率的映射,将透射函数直接作用于高斯原语。训练时联合学习大气光照与散射系数,同时优化雾天场景的高斯表示。推理时,消除高斯分布中的散射与衰减影响,直接渲染出去雾视图。在真实与合成雾天数据集上的实验表明,DehazeGS性能达当前最优水平。可视化见 https://jz-y-cn.github.io/DehazeGS/

原文摘要 · Abstract (English)

Current novel view synthesis methods are typically designed for high-quality and clean input images. However, in foggy scenes, scattering and attenuation can significantly degrade the quality of rendering. Although NeRF-based dehazing approaches have been developed, their reliance on deep fully connected neural networks and per-ray sampling strategies leads to high computational costs. Furthermore, NeRF's implicit representation limits its ability to recover fine-grained details from hazy scenes. To overcome these limitations, we propose learning an explicit Gaussian representation to explain the formation mechanism of foggy images through a physically forward rendering process. Our method, DehazeGS, reconstructs and renders fog-free scenes using only multi-view foggy images as input. Specifically, based on the atmospheric scattering model, we simulate the formation of fog by establishing the transmission function directly onto Gaussian primitives via depth-to-transmission mapping. During training, we jointly learn the atmospheric light and scattering coefficients while optimizing the Gaussian representation of foggy scenes. At inference time, we remove the effects of scattering and attenuation in Gaussian distributions and directly render the scene to obtain dehazed views. Experiments on both real-world and synthetic foggy datasets demonstrate that DehazeGS achieves state-of-the-art performance. visualizations are available at https://jz-y-cn.github.io/DehazeGS/

去雾3D高斯渲染视觉重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。