arXiv:2608.18215cs.CV2026-08

用令牌空间直接变换光照,实现可逐步叠加的3D重光照。

LumiTokens: 3D Relighting via Token-Space Lighting Transformation

论文配图:LumiTokens: 3D Relighting via Token-Space Lighting Transformation
图 1 · 摘自论文原文
  • 在隐式场景令牌上直接做光照变换,无需重建3D结构或物理分解。
  • 支持环境光、点光源、面光源统一建模,且可逐个添加光源。
  • 用户可渐进式调整光照,每次修改都在同一潜空间完成。

现有3D重光照方法依赖显式材质分解、基于扩散的视图生成或两者结合,需为每种新光照条件完全重新计算。我们观察到,近期的隐式场景表示将多视角图像编码为无固定物理语义的紧凑令牌,为重光照开辟了新设计空间。本文提出LumiTokens,将3D重光照建模为对隐式场景令牌的直接变换,无需显式3D表示、渲染方程或物理分解。模型引入场景令牌编辑器,通过自注意力机制联合处理场景令牌与光线令牌,生成可解码为多视角一致重光照图像的新令牌。为支持多种光照类型的一致接口,所有光照信号(包括环境贴图、点光源、面光源)均参数化为Plucker射线令牌,实现无显式空间结构下的原生3D交互。关键优势在于支持渐进式重光照:因编辑输出保持与输入相同的潜空间,用户可逐个光源叠加照明,每次编辑在令牌空间中组合完成。实验表明,LumiTokens在重光照质量上达到或优于现有方法,并支持可组合的渐进式光照编辑。

原文摘要 · Abstract (English)

Existing 3D relighting methods operate through either explicit material decomposition, diffusion-based view-space generation, or a combination of both, requiring full recomputation for each new lighting condition. We observe that recent latent scene representations, which encode multi-view images into a set of compact tokens with no fixed physical semantics, open up a novel design space for relighting. We present LumiTokens, a framework that formulates 3D relighting as a direct transformation on latent scene tokens, without explicit 3D representations, rendering equations, or physics-based decomposition. Our model introduces a Scene Token Editor that processes scene tokens jointly with light-ray tokens through self-attention, producing updated tokens that can be decoded into multi-view-consistent relit images. To support diverse lighting types through a unified interface, all lighting signals, including environment maps, point lights, and area lights, are parameterized as Plucker ray tokens, enabling native 3D user interaction with a representation that carries no explicit spatial structure. Crucially, this design supports progressive relighting: because the editor's output remains in the same latent space as its input, a user can incrementally build up illumination one light source at a time, with each edit composing in token space. Experiments demonstrate that LumiTokens achieves comparable or superior relighting quality to other methods and supports progressive, composable lighting edits. Project page: https://neu-vi.github.io/LumiTokens/

3D重光照令牌空间渐进编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。