arXiv:2604.21654cs.CVcs.AI2026-04

通过因果解耦学习图像退化特征,实现无需标签的高质量图像评估。

Causal Disentanglement-Inspired Degradation Representation Learning for Full-Reference Image Quality Assessment

论文配图:Causal Disentanglement-Inspired Degradation Representation Learning for Full-Reference Image Quality Assessment
图 1 · 摘自论文原文
  • 基于因果推断与表征解耦,分离内容与退化信息。
  • 在标准数据集上达到领先性能,少样本和无标签场景也表现优异。
  • 适用于水下、医学等低资源领域,跨域泛化能力强。

现有基于深度网络的全参考图像质量评估(FR-IQA)模型通常通过对比参考图与失真图的深层特征来工作。本文从新视角出发,提出一种基于因果推断和解耦表征学习的新型FR-IQA范式。不同于传统的特征对比方法,本方法将退化估计建模为由潜在表示干预引导的因果解耦过程。首先,利用参考图与失真图间的内容不变性,解耦出退化与内容表征;其次,受人类视觉掩蔽效应启发,设计掩蔽模块以建模图像内容与退化特征间的因果关系,从而从失真图像中提取受内容影响的退化特征;最后,通过监督回归或无标签降维预测质量分数。大量实验表明,该方法在标准IQA基准上,在完全监督、少样本及无标签设置下均表现卓越。此外,我们在水下、放射、医疗、中子成像及屏幕内容等非标准自然图像领域进行评估,面对数据稀缺情况,得益于其无需标注数据即可进行场景特定训练与预测的能力,相比现有无训练FR-IQA模型展现出更强的跨域泛化能力。

原文摘要 · Abstract (English)

Existing deep network-based full-reference image quality assessment (FR-IQA) models typically work by performing pairwise comparisons of deep features from the reference and distorted images. In this paper, we approach this problem from a different perspective and propose a novel FR-IQA paradigm based on causal inference and decoupled representation learning. Unlike typical feature comparison-based FR-IQA models, our approach formulates degradation estimation as a causal disentanglement process guided by intervention on latent representations. We first decouple degradation and content representations by exploiting the content invariance between the reference and distorted images. Second, inspired by the human visual masking effect, we design a masking module to model the causal relationship between image content and degradation features, thereby extracting content-influenced degradation features from distorted images. Finally, quality scores are predicted from these degradation features using either supervised regression or label-free dimensionality reduction. Extensive experiments demonstrate that our method achieves highly competitive performance on standard IQA benchmarks across fully supervised, few-label, and label-free settings. Furthermore, we evaluate the approach on diverse non-standard natural image domains with scarce data, including underwater, radiographic, medical, neutron, and screen-content images. Benefiting from its ability to perform scenario-specific training and prediction without labeled IQA data, our method exhibits superior cross-domain generalization compared to existing training-free FR-IQA models.

图像质量评估因果推断无监督学习跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。