单视角捕捉下实现室内灯光的分离与实时重光照
LuxRemix: Lighting Decomposition and Remixing for Indoor Scenes
- 通过生成式图像分解模型将复杂光照拆分为独立光源
- 支持对灯光开关、色温、亮度的独立控制，效果逼真
- 适合需要精细灯光编辑的影视渲染与虚拟场景构建
我们提出一种从单个多视角场景捕获中实现交互式室内灯光编辑的新方法。该方法利用生成式基于图像的光照分解模型，将复杂的室内场景光照分解为多个独立光源。这种分解使用户能够独立操控每个光源的状态（开启/关闭）、色度和强度。此外，我们引入多视角光照一致性校准技术，确保光照分解在所有场景视角间保持一致。该方法集成于可重光照的3D高斯点云表示中，实现了对各光源的实时交互控制。我们在合成与真实世界数据集上评估了该方法，并与当前最先进技术进行了定量与定性对比。视频演示与交互展示详见 https://luxremix.github.io。
原文摘要 · Abstract (English)
We present a novel approach for interactive light editing in indoor scenes from a single multi-view scene capture. Our method leverages a generative image-based light decomposition model that factorizes complex indoor scene illumination into its constituent light sources. This factorization enables independent manipulation of individual light sources, specifically allowing control over their state (on/off), chromaticity, and intensity. We further introduce multi-view lighting harmonization to ensure consistent propagation of the lighting decomposition across all scene views. This is integrated into a relightable 3D Gaussian splatting representation, providing real-time interactive control over the individual light sources. Our results demonstrate highly photorealistic lighting decomposition and relighting outcomes across diverse indoor scenes. We evaluate our method on both synthetic and real-world datasets and provide a quantitative and qualitative comparison to state-of-the-art techniques. For video results and interactive demos, see https://luxremix.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。