arXiv:2503.10259cs.CV2025-03CVPR被引 14

通过视觉显著性引导局部感知,提升视频质量评估精度

KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception

  • 基于人类视觉系统,融合显著性与局部纹理特征
  • 在5个基准上超越现有方法,显著提升全局质量预测
  • 新构建带区域标注的LPVQ数据集,适合视频优化研究者

视频质量评估(VQA)旨在预测视频的主观感知质量。由于运动模糊或特定失真,视频不同区域的质量差异明显。识别视频中各区域的局部质量有助于整体质量评估,并可指导精细化增强或转码策略。然而,区域级质量标注成本高,缺乏相应数据集的真值约束,限制了局部感知的应用。受人类视觉系统启发,我们提出全景视频质量评估框架(KVQ),通过融合窗口注意力机制(FWA)提取视觉显著性并分配注意力,结合局部感知约束(LPC)减少局部纹理感知对邻域的依赖。在五个主流VQA基准上,KVQ在多种场景下均显著优于当前最优方法。此外,我们构建了新的局部感知视觉质量(LPVQ)数据集,包含区域级标注。实验表明KVQ具备感知局部失真的能力。相关模型与数据集将开源于https://github.com/qyp2000/KVQ。

原文摘要 · Abstract (English)

Video Quality Assessment (VQA), which intends to predict the perceptual quality of videos, has attracted increasing attention. Due to factors like motion blur or specific distortions, the quality of different regions in a video varies. Recognizing the region-wise local quality within a video is beneficial for assessing global quality and can guide us in adopting fine-grained enhancement or transcoding strategies. Due to the heavy cost of annotating region-wise quality, the lack of ground truth constraints from relevant datasets further complicates the utilization of local perception. Inspired by the Human Visual System (HVS) that links global quality to the local texture of different regions and their visual saliency, we propose a Kaleidoscope Video Quality Assessment (KVQ) framework, which aims to effectively assess both saliency and local texture, thereby facilitating the assessment of global quality. Our framework extracts visual saliency and allocates attention using Fusion-Window Attention (FWA) while incorporating a Local Perception Constraint (LPC) to mitigate the reliance of regional texture perception on neighboring areas. KVQ obtains significant improvements across multiple scenarios on five VQA benchmarks compared to SOTA methods. Furthermore, to assess local perception, we establish a new Local Perception Visual Quality (LPVQ) dataset with region-wise annotations. Experimental results demonstrate the capability of KVQ in perceiving local distortions. KVQ models and the LPVQ dataset will be available at https://github.com/qyp2000/KVQ.

视频质量评估显著性感知局部感知图像质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。