在原始数据域中分离烟雾影响,实现更清晰的3D场景重建。
FujinSplat: Seeing Through Smoke with RAW-Domain Gaussian Splatting

- 在RAW域建模,分离烟雾与图像处理过程
- 在真实烟雾数据集上超越现有最强基线
- 适合需要高精度3D重建的视觉系统研究者
烟雾场景的外观由两个过程共同决定:参与介质以视点依赖方式改变场景辐射,随后图像信号处理器(ISP)通过非线性色调和色彩变换重映射结果。恢复干净3D场景需分离这两个过程。现有方法在sRGB域进行逐帧去雾,但此时两者已纠缠;标准3D重建则忽略介质,将其纳入几何与辐射。FujinSplat在RAW域解决此问题,保持两过程可分。通过拟合场景级基础ISP(从模糊的RAW图像与相机渲染对中学习并冻结),提供固定光照锚点,不执行去雾。分析专家修正发现,仅从RAW即可识别紧凑的低维修正空间。因此,FujinSplat在训练姿态处拟合每视角修正动作,并训练一个通用控制器从RAW回归这些动作;修正后的视图联合监督单一静态3D高斯表示及有界每视角残差,以调和跨视角光度不一致。在RealX3D真实烟雾基准测试中,FujinSplat显著优于最强对比基线,超越基于物理的重建与修复后3DGS流水线。
原文摘要 · Abstract (English)
The appearance of a smoky scene is shaped by two processes that a camera records together: the participating medium alters scene radiance in a view-dependent way, and the image signal processor (ISP) then remaps the result through a nonlinear tone and color transformation. Recovering a clean 3D scene requires separating both. Per-view sRGB dehazing acts only after the ISP has entangled them; standard 3D reconstruction ignores the medium and absorbs it into scene geometry and radiance. FujinSplat addresses the problem in the RAW domain, where the two processes remain separable. A per-scene Base ISP is fitted from the scene's hazy RAW captures to its own camera renderings and then frozen, providing a fixed photometric anchor that performs no dehazing. Analyzing expert corrections reveals a compact, low-dimensional correction space identifiable from RAW alone. FujinSplat therefore fits per-view action answers at the training poses and trains a single scene-agnostic controller to regress them from RAW; the corrected views supervise one static 3D Gaussian representation, jointly with a bounded per-view residual that reconciles cross-view photometric inconsistencies. On the RealX3D real-world smoke benchmark FujinSplat clearly outperforms the strongest comparable baseline, ahead of both physics-based reconstruction and restoration-then-3DGS pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。