用可学习的差分金字塔提升HDR图像色调映射的细节与一致性
Learning Differential Pyramid Representation for Tone Mapping
- 设计可自适应的差分金字塔,替代传统手工构造的高斯金字塔
- 在4K HDR+和HDRI Haven数据集上分别提升2.39和3.01 dB的PSNR
- 适合需要保留纹理结构、避免光晕伪影的HDR图像处理场景
现有色调映射方法通常在降采样输入上操作,并依赖手工构建的金字塔来恢复高频细节,这类设计在复杂HDR场景中常无法保持精细纹理和结构保真度。此外,多数方法缺乏有效机制同时建模全局色调一致性和局部对比度增强,导致输出全局平淡或局部不一致,如产生光晕伪影。本文提出端到端的差分金字塔表示网络(DPRNet),核心是可学习的差分金字塔,通过跨尺度的内容感知差分操作,泛化传统拉普拉斯和高斯差分金字塔,能自适应捕捉不同亮度与对比度条件下的高频变化。为保证感知一致性,DPRNet引入在降采样输入上运行的全局色调感知与局部色调调优模块,实现高效而丰富的色调适应。最后,迭代式细节增强模块以粗到精方式逐步恢复全分辨率输出,强化结构与锐度。实验表明,DPRNet达到当前最优性能,在4K HDR+数据集上提升2.39 dB PSNR,4K HDRI Haven数据集上提升3.01 dB,同时生成感知连贯、细节丰富的结果。
原文摘要 · Abstract (English)
Existing tone mapping methods operate on downsampled inputs and rely on handcrafted pyramids to recover high-frequency details. These designs typically fail to preserve fine textures and structural fidelity in complex HDR scenes. Furthermore, most methods lack an effective mechanism to jointly model global tone consistency and local contrast enhancement, leading to globally flat or locally inconsistent outputs such as halo artifacts. We present the Differential Pyramid Representation Network (DPRNet), an end-to-end framework for high-fidelity tone mapping. At its core is a learnable differential pyramid that generalizes traditional Laplacian and Difference-of-Gaussian pyramids through content-aware differencing operations across scales. This allows DPRNet to adaptively capture high-frequency variations under diverse luminance and contrast conditions. To enforce perceptual consistency, DPRNet incorporates global tone perception and local tone tuning modules operating on downsampled inputs, enabling efficient yet expressive tone adaptation. Finally, an iterative detail enhancement module progressively restores the full-resolution output in a coarse-to-fine manner, reinforcing structure and sharpness. Experiments show that DPRNet achieves state-of-the-art results, improving PSNR by 2.39 dB on the 4K HDR+ dataset and 3.01 dB on the 4K HDRI Haven dataset, while producing perceptually coherent, detail-preserving results. \textit{We provide an anonymous online demo at https://xxxxxxdprnet.github.io/DPRNet/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。