仅用一面反光表面的局部图像,重建周围环境光照图。
PanoLess: Environment Reconstruction from Partial Reflective Views

- 用表面对齐的2D高斯点云与延迟着色,恢复像素级法线和反射特征
- 融合为神经立方体贴图,实现高保真、几何一致的环境重建
- 支持部分视角输入,适合真实世界反光物体场景建模
镜面物体和玻璃幕墙能自然扩展相机视场,无需转动镜头或获取全景即可捕捉周围环境。我们提出PanoLess,一种基于高斯点云的框架,仅需从反射面一侧拍摄的图像,即可重建出远处的环境光照图。PanoLess利用表面对齐的2D高斯点云与延迟着色技术,准确恢复每像素的法线与反射线索,并将其融合为环境的神经立方体贴图表示。此外,该方法生成显式的可见性图,标明哪些环境区域由部分反射观测所支持。相比现有逆渲染与反光感知高斯点云方法通常需要360度完整覆盖且在不完整视图下表现不佳,PanoLess可在部分视角输入下实现一致且物理合理的光照估计。实验表明,PanoLess在新构建的合成基准与公开数据集上均优于基线方法,且在真实反光捕获场景中展现良好泛化能力。
原文摘要 · Abstract (English)
Reflections from shiny objects and glass facades naturally extend the field of view of a camera, capturing the surrounding environment without the need to pan the camera or acquire a full panorama. We propose PanoLess, a Gaussian-splat-based framework that reconstructs the surrounding environment as a distant illumination map from images captured on only one side of a reflective surface. PanoLess leverages surface-aligned 2D Gaussian splats with deferred shading to recover accurate per-pixel normals and reflection cues, which are fused into a neural cubemap representation of the environment. In addition, PanoLess produces a visibility map that explicitly denotes which regions of the environment are supported by the partial reflective observations. Unlike existing inverse-rendering and reflection-aware Gaussian-splatting approaches, which typically require full 360-degree coverage and struggle under incomplete views, PanoLess enables consistent, physically grounded illumination estimation from partial-view input. We show that PanoLess achieves high-fidelity and geometrically consistent environment reconstruction, outperforming reflection-aware baselines on a new custom synthetic benchmark and publicly available datasets, and demonstrating generalization to real-world reflective captures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。