建模图像内容与失真间的高阶交互,提升无参考图像质量评估精度
Content-Distortion High-Order Interaction for Blind Image Quality Assessment
- 通过分层交互模块显式建模内容与失真的独立及联合影响
- 在LIVE、CLIVE等数据集上皮尔逊相关系数超当前最佳方法0.03以上
- 适合需要高精度且泛化能力强的图像质量评估场景
内容和失真被广泛认为是影响图像视觉质量的两大核心因素。现有无参考图像质量评估(NR-IQA)方法虽已建模这两者,却未能捕捉其复杂交互关系,导致质量感知不准确。为此,本文分析了交互建模的关键特性,提出一种名为CoDI-IQA(Content-Distortion high-order Interaction for NR-IQA)的鲁棒性无参考质量评估方法。该方法在分层交互框架中聚合局部失真与全局内容特征,设计渐进式感知交互模块(PPIM),通过内部、粗粒度与细粒度交互实现高阶交互建模,精准捕捉内在交互模式。为增强交互能力,采用多个PPIM在不同粒度上层次融合多级内容与失真特征,并定制适配训练策略以维持交互稳定性。大量实验表明,所提方法在预测准确性、数据效率和泛化能力方面显著优于现有最优方法。
原文摘要 · Abstract (English)
The content and distortion are widely recognized as the two primary factors affecting the visual quality of an image. While existing No-Reference Image Quality Assessment (NR-IQA) methods have modeled these factors, they fail to capture the complex interactions between content and distortions. This shortfall impairs their ability to accurately perceive quality. To confront this, we analyze the key properties required for interaction modeling and propose a robust NR-IQA approach termed CoDI-IQA (Content-Distortion high-order Interaction for NR-IQA), which aggregates local distortion and global content features within a hierarchical interaction framework. Specifically, a Progressive Perception Interaction Module (PPIM) is proposed to explicitly simulate how content and distortions independently and jointly influence image quality. By integrating internal interaction, coarse interaction, and fine interaction, it achieves high-order interaction modeling that allows the model to properly represent the underlying interaction patterns. To ensure sufficient interaction, multiple PPIMs are employed to hierarchically fuse multi-level content and distortion features at different granularities. We also tailor a training strategy suited for CoDI-IQA to maintain interaction stability. Extensive experiments demonstrate that the proposed method notably outperforms the state-of-the-art methods in terms of prediction accuracy, data efficiency, and generalization ability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。