arXiv:2412.15847eess.IVcs.CV2024-12

不依赖训练数据,用频域分析模拟人眼感知来评估图像质量

Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distance

  • 通过小波变换提取多尺度视觉特征,模拟人眼对不同频率失真的感知
  • 用豪斯多夫距离衡量特征分布差异,能有效处理异常值和容忍一定失真
  • 无需标注数据即可精准匹配人类视觉系统判断,适合无监督质量评估

现有全参考图像质量评估(FR-IQA)方法通常融合参考图与失真图的特征,却忽略了颜色和亮度失真主要出现在低频,而边缘和纹理失真集中在高频。本文提出一种开创性的免训练FR-IQA方法,通过新颖的感知退化建模,准确预测符合人类视觉系统(HVS)的图像质量。首先,协作特征精炼模块采用精心设计的小波变换提取感知相关特征,捕捉多尺度感知信息,模仿人眼在空间与频率域中对视觉信息的多尺度、多方向分析。其次,基于豪斯多夫距离的分布相似性度量模块,鲁棒地评估参考图与失真图特征分布的差异,有效应对异常值和变化,模拟人眼对某些失真的容忍能力。该方法无需训练数据或主观评分,即可精准捕捉感知质量差异。在多个基准数据集上的大量实验表明,其性能优于现有最先进方法,展现出与人类视觉系统高度相关的评估能力。

原文摘要 · Abstract (English)

Current full-reference image quality assessment (FR-IQA) methods often fuse features from reference and distorted images, overlooking that color and luminance distortions occur mainly at low frequencies, whereas edge and texture distortions occur at high frequencies. This work introduces a pioneering training-free FR-IQA method that accurately predicts image quality in alignment with the human visual system (HVS) by leveraging a novel perceptual degradation modelling approach to address this limitation. First, a collaborative feature refinement module employs a carefully designed wavelet transform to extract perceptually relevant features, capturing multiscale perceptual information and mimicking how the HVS analyses visual information at various scales and orientations in the spatial and frequency domains. Second, a Hausdorff distance-based distribution similarity measurement module robustly assesses the discrepancy between the feature distributions of the reference and distorted images, effectively handling outliers and variations while mimicking the ability of HVS to perceive and tolerate certain levels of distortion. The proposed method accurately captures perceptual quality differences without requiring training data or subjective quality scores. Extensive experiments on multiple benchmark datasets demonstrate superior performance compared with existing state-of-the-art approaches, highlighting its ability to correlate strongly with the HVS.\footnote{The code is available at \url{https://anonymous.4open.science/r/CVPR2025-F339}.}

图像质量评估感知建模小波变换免训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。