用闪光灯和高斯点云实现3D反射光分离,无需配对数据采集。
Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats
- 利用闪光灯提示与3D高斯点云,实现无配对图像的反射分离。
- 在真实场景中成功重建透射与反射场景的3D结构,效果显著优于现有方法。
- 适合需要简化采集流程的3D场景重建与反射去除应用。
我们提出一种简单而有效的方法,用于分离透射光与反射光。核心洞察是,现代逆向渲染方法(如3D高斯点云)强大的新视角合成能力,使我们能够仅使用未配对的闪关灯/非闪关灯图像实现反射分离——这一放松条件大幅简化了图像采集过程。通过大量真实世界实验,我们验证了所提方法Flash-Splat能准确重建透射与反射场景的3D结构。该方法显著优于不依赖光照控制的现有3D反射分离方法。项目主页见https://flash-splat.github.io/。
原文摘要 · Abstract (English)
We introduce a simple yet effective approach for separating transmitted and reflected light. Our key insight is that the powerful novel view synthesis capabilities provided by modern inverse rendering methods (e.g.,~3D Gaussian splatting) allow one to perform flash/no-flash reflection separation using unpaired measurements -- this relaxation dramatically simplifies image acquisition over conventional paired flash/no-flash reflection separation methods. Through extensive real-world experiments, we demonstrate our method, Flash-Splat, accurately reconstructs both transmitted and reflected scenes in 3D. Our method outperforms existing 3D reflection separation methods, which do not leverage illumination control, by a large margin. Our project webpage is at https://flash-splat.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。