通过显式建模失真先验,提升无参考图像质量评估的感知一致性。
DR.Experts: Differential Refinement of Distortion-Aware Experts for Blind Image Quality Assessment
- 引入失真敏感差异模块,分离失真与语义注意力,增强失真表征可靠性。
- 在5个基准上优于现有方法,尤其在泛化性和数据效率上表现突出。
- 适合需要高感知一致性的图像质量评估场景,如自动化视觉系统。
无参考图像质量评估(BIQA)旨在模拟人类对视觉质量的感知,但现有模型常无法捕捉细微失真线索,导致与主观判断不一致。我们发现其根源在于缺乏可靠的失真先验:传统方法仅学习统一图像特征与质量分数之间的浅层关系,对失真不敏感。为此,我们提出DR.Experts,一种基于先验的新型BIQA框架。首先利用退化感知视觉-语言模型获取失真特定先验,再通过提出的失真显著性差异模块,将其与语义注意力区分开,确保失真表征的真实性。随后,融合优化后的先验、语义及桥接表示,通过动态失真加权模块按感知影响权重各失真特征,使最终质量预测更贴近人类感知。在五个挑战性BIQA基准上的实验表明,该方法显著优于当前主流方法,展现出卓越的泛化能力与数据效率。
原文摘要 · Abstract (English)
Blind Image Quality Assessment, aiming to replicate human perception of visual quality without reference, plays a key role in vision tasks, yet existing models often fail to effectively capture subtle distortion cues, leading to a misalignment with human subjective judgments. We identify that the root cause of this limitation lies in the lack of reliable distortion priors, as methods typically learn shallow relationships between unified image features and quality scores, resulting in their insensitive nature to distortions and thus limiting their performance. To address this, we introduce DR.Experts, a novel prior-driven BIQA framework designed to explicitly incorporate distortion priors, enabling a reliable quality assessment. DR.Experts begins by leveraging a degradation-aware vision-language model to obtain distortion-specific priors, which are further refined and enhanced by the proposed Distortion-Saliency Differential Module through distinguishing them from semantic attentions, thereby ensuring the genuine representations of distortions. The refined priors, along with semantics and bridging representation, are then fused by a proposed mixture-of-experts style module named the Dynamic Distortion Weighting Module. This mechanism weights each distortion-specific feature as per its perceptual impact, ensuring that the final quality prediction aligns with human perception. Extensive experiments conducted on five challenging BIQA benchmarks demonstrate the superiority of DR.Experts over current methods and showcase its excellence in terms of generalization and data efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。