arXiv:2508.14814cs.CVcs.AI2025-08被引 2

让灯光风格自由迁移,同时保持图像内容不变

TransLight: Image-Guided Customized Lighting Control with Generative Decoupling

  • 用生成解耦分离图像内容与光照,构建百万级三元组数据集
  • 通过条件控制实现跨图像复杂光影的高保真迁移
  • 适合需要精细调光的影视、游戏与设计领域用户

现有光照编辑方法难以同时实现个性化光照控制与内容完整性保留,尤其在将复杂光照从参考图迁移到指定目标图时表现不佳。为此,我们提出TransLight框架,实现高保真、高自由度的光照迁移。方法核心在于从参考图中精准提取光照效果,难点在于光照与内容在真实场景中高度耦合。为此,我们提出生成解耦(Generative Decoupling),使用两个微调的扩散模型分离图像内容与光照效果,并构建了一个包含百万级图像-内容-光照三元组的新数据集。随后,采用IC-Light作为生成模型,以三元组训练模型,并将参考光照图作为额外条件信号注入。所提出的TransLight可实现多样化、自然且定制化的光照迁移。通过彻底解耦参考图中的光照效果,生成解耦策略赋予TransLight高度灵活的光照控制能力。实验表明,TransLight是首个成功实现跨差异图像光照迁移的方法,其定制化控制能力超越现有技术,为光照调和与编辑研究开辟新方向。

原文摘要 · Abstract (English)

Most existing illumination-editing approaches fail to simultaneously provide customized control of light effects and preserve content integrity. This makes them less effective for practical lighting stylization requirements, especially in the challenging task of transferring complex light effects from a reference image to a user-specified target image. To address this problem, we propose TransLight, a novel framework that enables high-fidelity and high-freedom transfer of light effects. Extracting the light effect from the reference image is the most critical and challenging step in our method. The difficulty lies in the complex geometric structure features embedded in light effects that are highly coupled with content in real-world scenarios. To achieve this, we first present Generative Decoupling, where two fine-tuned diffusion models are used to accurately separate image content and light effects, generating a newly curated, million-scale dataset of image-content-light triplets. Then, we employ IC-Light as the generative model and train our model with our triplets, injecting the reference lighting image as an additional conditioning signal. The resulting TransLight model enables customized and natural transfer of diverse light effects. Notably, by thoroughly disentangling light effects from reference images, our generative decoupling strategy endows TransLight with highly flexible illumination control. Experimental results establish TransLight as the first method to successfully transfer light effects across disparate images, delivering more customized illumination control than existing techniques and charting new directions for research in illumination harmonization and editing.

图像编辑光照迁移扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。