提出新方法让机器像人一样多尺度判断图像质量
Scale Contrastive Learning with Selective Attentions for Blind Image Quality Assessment
- 用注意力机制筛选跨尺度冗余信息,保留关键质量特征
- 通过对比学习捕捉不同尺度间的真实质量差异,提升评估精度
- 适合需要精准图像质量检测的场景,如真实世界图像分析
人类视觉感知天然具有多尺度评估图像质量的能力,而现有无参考图像质量评估(BIQA)算法难以有效复现这一过程。根源在于当前多尺度方法未意识到质量感知在不同尺度间存在显著差异——近距离看失真严重的内容,远观可能仍可接受。这种不一致导致特征融合时产生误导性‘视觉错觉’,并引入大量冗余信息,稀释了关键质量特征,造成评估不准。本文提出的CSFIQA框架通过两项创新突破:(1) 可选择聚焦的注意力机制,模拟人类视觉注意力,过滤掉会掩盖细微质量线索的冗余跨尺度信息;(2) 尺度对比学习策略,显式学习跨尺度及同内容内不同尺度间的质量变化。结合自适应噪声样本匹配机制,有效识别同一内容在不同尺度下的感知质量差异。实验表明,该方法在七个数据集上均显著优于现有最优方法,在真实世界复杂失真下最高实现8.8%的SRCC提升,验证了其与人类感知更强的一致性。
原文摘要 · Abstract (English)
Human visual perception naturally evaluates image quality across multiple scales, a hierarchical process that existing blind image quality assessment (BIQA) algorithms struggle to replicate effectively. This limitation stems from a fundamental misunderstanding: current multi-scale approaches fail to recognize that quality perception varies dramatically between scales -- what appears degraded when viewed closely may look acceptable from a distance. This inconsistency not only creates misleading ``visual illusions'' during feature fusion but also introduces substantial redundant information that dilutes quality-critical features and leads to imprecise assessments. Our CSFIQA framework advances multi-scale BIQA via two key innovations: (1) a selective focus attention mechanism that mimics human visual attention by filtering out redundant cross-scale information that would otherwise mask subtle quality indicators, and (2) a scale contrastive learning strategy that explicitly learns to distinguish quality variations both across and within scales. By incorporating an adaptive noise sample matching mechanism, CSFIQA effectively identifies perceptual quality discrepancies in the same content viewed at different scales. Experiments demonstrate substantial improvements over state-of-the-art methods across seven datasets, achieving up to 8.8% SRCC improvement on challenging real-world distortions, confirming CSFIQA's superior alignment with human quality perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。