用真实HDR视频做先验,提升SDR转HDR的准确性和可靠性。
Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion
- 引入真实HDR视频作为先验,将无参照预测转为有参照选择。
- 在真实和合成数据集上,客观与主观指标均显著提升。
- 适合需要高质量HDR视频转换的工业应用与研究者。
HDR-WCG显示设备的兴起凸显了将SDRTV转换为HDRTV的需求,因为大多数视频源仍为SDR。现有方法主要聚焦于设计神经网络以学习从SDRTV到HDRTV的单一风格映射。然而,SDRTV信息有限且现实转换风格多样,导致该问题为病态问题,制约了方法性能与泛化能力。受生成式方法启发,我们提出一种由真实HDRTV先验引导的SDRTV至HDRTV转换新方法。尽管SDRTV信息有限,引入真实HDRTV作为参考先验可显著缩小原高维病态问题的解空间。这一转变使任务从无参照预测转为有参照选择,从而大幅提高转换过程的准确性与可靠性。具体而言,本方法包含两个阶段:第一阶段采用向量量化生成对抗网络捕获HDRTV先验;第二阶段将这些先验与输入的SDRTV内容匹配,以恢复出逼真的HDRTV输出。我们在公开数据集上评估了该方法,结果表明其在真实与合成数据集上均取得显著的客观与主观指标提升。
原文摘要 · Abstract (English)
The rise of HDR-WCG display devices has highlighted the need to convert SDRTV to HDRTV, as most video sources are still in SDR. Existing methods primarily focus on designing neural networks to learn a single-style mapping from SDRTV to HDRTV. However, the limited information in SDRTV and the diversity of styles in real-world conversions render this process an ill-posed problem, thereby constraining the performance and generalization of these methods. Inspired by generative approaches, we propose a novel method for SDRTV to HDRTV conversion guided by real HDRTV priors. Despite the limited information in SDRTV, introducing real HDRTV as reference priors significantly constrains the solution space of the originally high-dimensional ill-posed problem. This shift transforms the task from solving an unreferenced prediction problem to making a referenced selection, thereby markedly enhancing the accuracy and reliability of the conversion process. Specifically, our approach comprises two stages: the first stage employs a Vector Quantized Generative Adversarial Network to capture HDRTV priors, while the second stage matches these priors to the input SDRTV content to recover realistic HDRTV outputs. We evaluate our method on public datasets, demonstrating its effectiveness with significant improvements in both objective and subjective metrics across real and synthetic datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。