arXiv:2507.11900eess.IVcs.CV2025-07被引 10

针对压缩高动态范围视频,提出通用质量评估模型。

CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videos

  • 用Swin Transformer和SigLip2分别构建全参考与无参考模型。
  • 在有限HDR数据下,通过预训练+微调提升性能。
  • 在国际竞赛中获全参考赛道第一名,适合视频压缩研究者。

视频压缩是减少存储与传输开销的标准流程,评估压缩视频的视觉质量对算法优化至关重要。现有压缩视频质量评估(VQA)方法普遍缺乏应对日益多样视频内容(尤其是高动态范围,HDR)的泛化能力。本文提出CompressedVQA-HDR框架,采用Swin Transformer作为全参考(FR)模型主干,利用中间层特征计算参考帧与失真帧间的深层结构与纹理相似性;使用SigLip 2作为无参考(NR)模型主干,提取最后一层特征图的全局均值作为质量感知表示。为缓解HDR训练数据稀缺问题,FR模型在大规模标准动态范围(SDR)VQA数据集上预训练,再于HDRSDR-VQA数据集微调;NR模型则通过多数据集迭代混合训练,并在HDRSDR-VQA上微调。实验表明,该模型在现有FR与NR VQA方法中表现最优,且CompressedVQA-HDR-FR在IEEE ICME 2025通用HDR与SDR视频质量评估挑战赛中获得全参考赛道第一名。代码已开源。

原文摘要 · Abstract (English)

Video compression is a standard procedure applied to all videos to minimize storage and transmission demands while preserving visual quality as much as possible. Therefore, evaluating the visual quality of compressed videos is crucial for guiding the practical usage and further development of video compression algorithms. Although numerous compressed video quality assessment (VQA) methods have been proposed, they often lack the generalization capability needed to handle the increasing diversity of video types, particularly high dynamic range (HDR) content. In this paper, we introduce CompressedVQA-HDR, an effective VQA framework designed to address the challenges of HDR video quality assessment. Specifically, we adopt the Swin Transformer and SigLip 2 as the backbone networks for the proposed full-reference (FR) and no-reference (NR) VQA models, respectively. For the FR model, we compute deep structural and textural similarities between reference and distorted frames using intermediate-layer features extracted from the Swin Transformer as its quality-aware feature representation. For the NR model, we extract the global mean of the final-layer feature maps from SigLip 2 as its quality-aware representation. To mitigate the issue of limited HDR training data, we pre-train the FR model on a large-scale standard dynamic range (SDR) VQA dataset and fine-tune it on the HDRSDR-VQA dataset. For the NR model, we employ an iterative mixed-dataset training strategy across multiple compressed VQA datasets, followed by fine-tuning on the HDRSDR-VQA dataset. Experimental results show that our models achieve state-of-the-art performance compared to existing FR and NR VQA models. Moreover, CompressedVQA-HDR-FR won first place in the FR track of the Generalizable HDR & SDR Video Quality Measurement Grand Challenge at IEEE ICME 2025. The code is available at https://github.com/sunwei925/CompressedVQA-HDR.

视频质量评估HDR视频深度学习压缩视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。