arXiv:2602.04814cs.CVcs.GR2026-02被引 6

将预训练模型适配到HDR生成,无需重新训练。

X2HDR: HDR Image Generation in a Perceptually Uniform Space

  • 在感知均匀空间中微调扩散模型的去噪器,保持编码器冻结。
  • 相比线性RGB,感知编码使HDR重建质量接近LDR水平。
  • 支持文生HDR和RAW转HDR,适合图像生成与后期处理研究者。

高动态范围(HDR)格式与显示设备日益普及,但主流图像生成模型(如Stable Diffusion和FLUX)仍主要输出低动态范围(LDR)图像,原因在于缺乏大规模HDR训练数据。本文表明,现有预训练扩散模型可无需从头训练即可适配至HDR生成。核心挑战在于:HDR图像以线性RGB表示,其亮度与色彩统计与sRGB编码的LDR图像差异显著。这一差距可通过转换为感知均匀编码(如PU21或PQ)有效弥合。实验发现,经过预训练的变分自编码器(VAEs)在处理PU21编码的HDR输入时,重建保真度与处理LDR数据相当;而线性RGB输入则导致严重退化。基于此,我们提出一种高效适配策略:冻结VAE,仅在感知均匀空间中通过低秩适应(LoRA)微调去噪器。该方法实现统一计算框架,支持文本到HDR生成与单张RAW图像到HDR重建。实验表明,相较已有技术,该方法在感知保真度、图文对齐性和有效动态范围方面均有显著提升。

原文摘要 · Abstract (English)

High-dynamic-range (HDR) formats and displays are becoming increasingly prevalent, yet state-of-the-art image generators (e.g., Stable Diffusion and FLUX) typically remain limited to low-dynamic-range (LDR) output due to the lack of large-scale HDR training data. In this work, we show that existing pretrained diffusion models can be easily adapted to HDR generation without retraining from scratch. A key challenge is that HDR images are natively represented in linear RGB, whose intensity and color statistics differ substantially from those of sRGB-encoded LDR images. This gap, however, can be effectively bridged by converting HDR inputs into perceptually uniform encodings (e.g., using PU21 or PQ). Empirically, we find that LDR-pretrained variational autoencoders (VAEs) reconstruct PU21-encoded HDR inputs with fidelity comparable to LDR data, whereas linear RGB inputs cause severe degradations. Motivated by this finding, we describe an efficient adaptation strategy that freezes the VAE and finetunes only the denoiser via low-rank adaptation in a perceptually uniform space. This results in a unified computational method that supports both text-to-HDR synthesis and single-image RAW-to-HDR reconstruction. Experiments demonstrate that our perceptually encoded adaptation consistently improves perceptual fidelity, text-image alignment, and effective dynamic range, relative to previous techniques.

HDR生成扩散模型感知均匀图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。