arXiv:2605.24700cs.CVcs.GR2026-05

利用阴影引导城市场景重建,实现逼真光照重演。

SRUG: Shadow-Guided Relightable Urban Scene with Generation Model

论文配图:SRUG: Shadow-Guided Relightable Urban Scene with Generation Model
图 1 · 摘自论文原文
  • 用阴影信息指导不可见区域的3D补全,生成合理阴影。
  • 通过迭代材质分解,提升复杂光照下的材质还原精度。
  • 适合需要高真实感城市场景重演的研究与应用。

从图像或视频中创建可重光照的城市场景极具实用价值,但问题高度病态。城市环境通常无边界,超出可见范围的部分仍可能在可见区域投下阴影。合理建模这些不可见区域的阴影极为困难,严重阻碍了可重光照场景的构建。同时,稀疏输入视角和复杂光照条件进一步加剧材质分解的模糊性。本文提出阴影引导的可重光照城市场景生成模型(SRUG),利用阴影信息引导3D补全模型恢复不可见区域几何结构,促进物理合理的阴影生成。此外,采用基于大材质模型(LMM)的迭代材质分解方案,实现鲁棒的材质属性分解。在此基础上,引入物理基础光照模型,捕捉城市场景的复杂光照并支持可靠重光照。大量定量评估与视觉对比表明,本方法在新视角合成与重光照任务上均优于现有方法。

原文摘要 · Abstract (English)

Creating relightable urban scenes from images or videos is widely useful but highly ill-posed. Urban environments are typically unbounded and extend beyond the visible regions. As a result, many portions of the scene remain unobserved, yet these invisible regions can cast shadows onto visible areas. Reasonably modeling shadows cast by such invisible regions is challenging and poses a significant obstacle to creating relightable urban scenes. At the same time, sparse input views and complex illumination conditions further complicate relighting, as they introduce severe ambiguities in material decomposition. In this paper, we propose Shadow-guided Relightable Urban Scene with Generation model (SRUG), a novel framework designed to address relighting challenges in urban scenes. SRUG leverages shadows to guide a 3D completion model for recovering the geometry of invisible regions, promoting the synthesis of physically reasonable shadows. In addition, SRUG employs an iterative material decomposition scheme that applies the large material model (LMM) to provide material supervision and iteratively decompose the scene's material properties, enabling robust material decomposition. Building upon these components, we introduce a physically-based lighting model that captures the complex illumination of urban scenes and supports reliable relighting. Extensive quantitative evaluations and visual comparisons demonstrate that our method outperforms existing approaches in both novel view synthesis and relighting tasks.

城市重建光影重演3D生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。