arXiv:2605.11696cs.CVcs.AI2026-05

首个真实场景单图光影重渲染数据集,解决合成到现实的泛化难题。

WildRelight: A Real-World Benchmark and Physics-Guided Adaptation for Single-Image Relighting

论文配图:WildRelight: A Real-World Benchmark and Physics-Guided Adaptation for Single-Image Relighting
图 1 · 摘自论文原文
  • 构建首个真实户外场景的单图光影重渲染数据集,含高动态光照序列。
  • 合成模型在真实数据上表现严重退化,域偏移问题突出。
  • 提出物理引导推理框架,实现无需标注的实时自监督适应。

近期基于生成模型的单图光影重渲染方法在合成基准上取得了令人印象深刻的逼真效果,但在复杂真实视觉环境中的有效性尚未得到充分验证。当前数据集通常面向多视角重建设计,难以应对单图重渲染的独特挑战。为弥合这一合成到现实的差距,我们提出WildRelight,首个专为评估单图重渲染模型而设计的真实世界数据集。该数据集包含多样化的高分辨率户外场景,由严格对齐、随时间变化的自然光照采集而成,每个场景均配有高动态范围环境图。基于此数据,我们建立了一个严格的基准,揭示了在合成数据上训练的先进模型存在严重的域偏移。WildRelight严格的时序对齐结构支持一种新的领域自适应范式。我们通过引入物理引导的推理框架,利用捕获的自然光演化作为自监督约束,结合扩散后验采样(DPS)与时序感知测试时自适应(TTA),证明该数据集可使合成模型即时对齐真实世界统计特性,将原本难以处理的模拟到现实挑战转化为可解的自监督任务。数据集与代码将公开发布,以促进稳健、物理基础的重渲染研究。

原文摘要 · Abstract (English)

Recent single-image relighting methods, powered by advanced generative models, have achieved impressive photorealism on synthetic benchmarks. However, their effectiveness in the complex visual landscape of the real world remains largely unverified. A critical gap exists, as current datasets are typically designed for multi-view reconstruction and fail to address the unique challenges of single-image relighting. To bridge this synthetic-to-real gap, we introduce WildRelight, the first in-the-wild dataset specifically created for evaluating single-image relighting models. WildRelight features a diverse collection of high-resolution outdoor scenes, captured under strictly aligned, temporally varying natural illuminations, each paired with a high-dynamic-range environment map. Using this data, we establish a rigorous benchmark revealing that state-of-the-art models trained on synthetic data suffer from severe domain shifts. The strictly aligned temporal structure of WildRelight enables a new paradigm for domain adaptation. We demonstrate this by introducing a physics-guided inference framework that leverages the captured natural light evolution as a self-supervised constraint. By integrating Diffusion Posterior Sampling (DPS) with temporal Sampling-Aware Test-Time Adaptation (TTA), we show that the dataset allows synthetic models to align with real-world statistics on-the-fly, transforming the intractable sim-to-real challenge into a tractable self-supervised task. The dataset and code will be made publicly available to foster robust, physically-grounded relighting research.

单图重渲染真实世界数据自监督学习物理建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。