arXiv:2608.29925cs.CV2026-08

用手绘笔触精准控制图像光照,提升真实场景下的重布光效果。

Dior: Drawing the Light of Image via Material-Decoupled Illumination Representation

论文配图:Dior: Drawing the Light of Image via Material-Decoupled Illumination Representation
图 1 · 摘自论文原文
  • 提出Lumi Map光照表示,解耦材质与光照,实现笔触到光照的明确映射。
  • 在合成数据训练后,结合真实重布光对进行重建训练,提升实际应用效果。
  • 支持对光照强度和色温的精细控制,适合图像编辑与虚拟拍摄场景。

可控图像重布光是图像编辑的重要问题,手绘涂鸦为指定光照提供了直观界面。然而,现有方法未能建立笔触输入与重布光结果之间的一致有效映射,限制了对光照强度、色温和复杂空间分布的控制能力。本文提出一种材质解耦的光照表示方法——Lumi Map,建立了用户涂鸦与最终光照之间的显式映射,显著提升了重布光的准确性和可控性。具体地,利用渲染器生成源图- Lumi Map-重布光图像三元组,训练模型基于Lumi Map预测目标重布光结果;为缓解合成数据引入的域偏移,进一步在真实重布光图像对上进行重建训练,增强模型在真实图像上的泛化能力。最终提出Dior-Light方法,通过手绘笔触控制图像重布光。大量实验表明,该方法在重布光精度上优于现有方法,并能有效控制真实场景图像的光照强度与色温。

原文摘要 · Abstract (English)

Controllable image relighting is an important problem in image editing, and hand-drawn scribbles provide an intuitive interface for specifying the desired illumination. However, existing methods do not establish a consistent and effective mapping between scribble inputs and relighting results, limiting their ability to control illumination intensity, chromaticity, and complex spatial distributions. We address this limitation by introducing a material-decoupled illumination representation, termed the Lumi Map, which establishes an explicit mapping between user scribbles and the resulting illumination, thereby improving both relighting accuracy and controllability. Specifically, we use a renderer to synthesize source image-Lumi Map-relit image triplets and train the model to predict the target relighting result conditioned on the Lumi Map. To mitigate the domain gap introduced by synthetic data, we further perform reconstruction training on real relighting pairs, improving the model's generalization to real-world images. Finally, we present Dior-Light, an image relighting method controlled by hand-drawn strokes. Extensive experiments demonstrate that our method outperforms existing approaches in relighting accuracy and enables effective control over illumination intensity and chromaticity on in-the-wild images.

图像重布光手绘控制光照建模真实场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。