arXiv:2412.18933cs.CVcs.MM2024-12AAAI被引 4

针对超分辨率视频的帧间不一致问题,提出新评估方法提升质量感知准确性。

Temporal Inconsistency Guidance for Super-resolution Video Quality Assessment

  • 通过感知导向量化每帧间时间不一致程度
  • 设计双尺度定位模块突出不一致区域
  • 模仿人眼机制分步融合时序特征,适合超分视频评估

随着超分辨率(SR)技术引入与传统退化过程(如压缩)本质不同的失真,对专门针对SR生成内容的视频质量评估(VQA)方法需求日益增长。其中关键因素是时间不一致性,即相邻帧间的不规则现象。然而现有方法极少量化该现象或研究其与人类感知的关系。此外,增强过程会放大不一致水平。本文提出「时间不一致性引导的超分辨率视频质量评估」(TIG-SVQA),强调时间不一致性在指导SR视频质量评估中的核心作用。首先设计感知导向方法量化帧级时间不一致性;基于此,引入不一致突出空间模块,实现粗细尺度下不一致区域定位;受人眼视觉系统启发,进一步构建不一致引导时间模块,进行渐进式时序特征聚合:(1) 一致性感知融合阶段,通过视觉记忆块自适应根据不一致水平确定各时间片段的信息负载;(2) 信息过滤阶段,突出与质量相关特征。在单帧与多帧SR视频场景下的大量实验表明,该方法显著优于现有先进VQA方法。代码已公开于 https://github.com/Lighting-YXLI/TIG-SVQA-main。

原文摘要 · Abstract (English)

As super-resolution (SR) techniques introduce unique distortions that fundamentally differ from those caused by traditional degradation processes (e.g., compression), there is an increasing demand for specialized video quality assessment (VQA) methods tailored to SR-generated content. One critical factor affecting perceived quality is temporal inconsistency, which refers to irregularities between consecutive frames. However, existing VQA approaches rarely quantify this phenomenon or explicitly investigate its relationship with human perception. Moreover, SR videos exhibit amplified inconsistency levels as a result of enhancement processes. In this paper, we propose \textit{Temporal Inconsistency Guidance for Super-resolution Video Quality Assessment (TIG-SVQA)} that underscores the critical role of temporal inconsistency in guiding the quality assessment of SR videos. We first design a perception-oriented approach to quantify frame-wise temporal inconsistency. Based on this, we introduce the Inconsistency Highlighted Spatial Module, which localizes inconsistent regions at both coarse and fine scales. Inspired by the human visual system, we further develop an Inconsistency Guided Temporal Module that performs progressive temporal feature aggregation: (1) a consistency-aware fusion stage in which a visual memory capacity block adaptively determines the information load of each temporal segment based on inconsistency levels, and (2) an informative filtering stage for emphasizing quality-related features. Extensive experiments on both single-frame and multi-frame SR video scenarios demonstrate that our method significantly outperforms state-of-the-art VQA approaches. The code is publicly available at https://github.com/Lighting-YXLI/TIG-SVQA-main.

视频质量评估超分辨率时间一致性感知建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。