arXiv:2604.02787cs.CVcs.AI2026-04

用物理与视觉感知引导的扩散模型,把8位标准画质转成高质量高动态范围图像。

LumaFlux: Lifting 8-Bit Worlds to HDR Reality with Physically-Guided Diffusion Transformers

  • 基于预训练扩散变换器,通过低秩残差注入亮度、空间和频域信息
  • 在多个基准上实现更优的亮度重建与色彩保真度,且参数增长极少
  • 适合图像增强、影视修复及高动态范围内容生成场景

HDR设备的普及带来了将8位标准动态范围(SDR)内容转换为感知与物理准确的10位高动态范围(HDR)的迫切需求。现有逆色调映射(ITM)方法依赖固定色调映射算子,难以泛化至真实退化、风格差异与相机处理流程,常导致高光截断、色彩饱和度下降或色调不稳定。我们提出LumaFlux,首个物理与感知双引导的扩散变换器(DiT),用于SDR-to-HDR重建。其创新包括:(1) 物理引导适配(PGA)模块,通过低秩残差将亮度、空间描述符与频率线索注入注意力;(2) 感知交叉调制(PCM)层,利用视觉编码器特征进行FiLM条件调节,稳定色度与纹理;(3) HDR残差耦合器,在时间步与层自适应调制下融合物理与感知信号。最后,轻量级有理二次样条解码器重建平滑可解释的色调场,增强VAE解码器输出以生成HDR图像。为支持鲁棒的HDR学习,我们构建了首个大规模的SDR-HDR训练语料库,并建立了包含HDR参考图与专家评分的SDR版本的新评估基准。在多个基准上,LumaFlux优于现有最先进方法,实现更优的亮度重建与感知色彩保真度,且额外参数极少。

原文摘要 · Abstract (English)

The rapid adoption of HDR-capable devices has created a pressing need to convert the 8-bit Standard Dynamic Range (SDR) content into perceptually and physically accurate 10-bit High Dynamic Range (HDR). Existing inverse tone-mapping (ITM) methods often rely on fixed tone-mapping operators that struggle to generalize to real-world degradations, stylistic variations, and camera pipelines, frequently producing clipped highlights, desaturated colors, or unstable tone reproduction. We introduce LumaFlux, a first physically and perceptually guided diffusion transformer (DiT) for SDR-to-HDR reconstruction by adapting a large pretrained DiT. Our LumaFlux introduces (1) a Physically-Guided Adaptation (PGA) module that injects luminance, spatial descriptors, and frequency cues into attention through low-rank residuals; (2) a Perceptual Cross-Modulation (PCM) layer that stabilizes chroma and texture via FiLM conditioning from vision encoder features; and (3) an HDR Residual Coupler that fuses physical and perceptual signals under a timestep- and layer-adaptive modulation schedule. Finally, a lightweight Rational-Quadratic Spline decoder reconstructs smooth, interpretable tone fields for highlight and exposure expansion, enhancing the output of the VAE decoder to generate HDR. To enable robust HDR learning, we curate the first large-scale SDR-HDR training corpus. For fair and reproducible comparison, we further establish a new evaluation benchmark, comprising HDR references and corresponding expert-graded SDR versions. Across benchmarks, LumaFlux outperforms state-of-the-art baselines, achieving superior luminance reconstruction and perceptual color fidelity with minimal additional parameters.

图像增强扩散模型HDR生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。