通过注意力融合多任务特征,提升无参考图像质量评估精度。
Multi-task Feature Enhancement Network for No-Reference Image Quality Assessment
- 引入高频提取与畸变感知网络,显式捕捉纹理和畸变特征。
- 在五个标准数据库上实现领先性能,跨数据集泛化能力强。
- 适合需要高精度图像质量评估的视觉系统研发人员。
由于图像质量评估(IQA)数据集标注样本稀缺,近年来许多研究提出基于多任务的策略,利用其他任务或领域的特征信息来增强IQA性能。然而,现有的无参考图像质量评估(NR-IQA)多任务方法仍面临挑战:其一,未显式利用对图像质量影响显著的纹理细节;其二,传统多任务方法通过加法或拼接等方式融合特征,削弱了网络对失真特征的精准表达能力。为此,本文提出一种新型多任务NR-IQA框架,包含三个核心组件:高频提取网络、质量评估网络和畸变感知网络。高频提取网络引导模型关注与纹理细节高度相关的高频信息;畸变感知网络提取与畸变类型相关的特征以实现区分。为有效融合多任务特征,设计基于注意力机制的特征融合模块。在五个标准IQA数据库上的实验证明,该方法不仅性能优异,且具备良好的泛化能力。
原文摘要 · Abstract (English)
Due to the scarcity of labeled samples in Image Quality Assessment (IQA) datasets, numerous recent studies have proposed multi-task based strategies, which explore feature information from other tasks or domains to boost the IQA task. Nevertheless, multi-task strategies based No-Reference Image Quality Assessment (NR-IQA) methods encounter several challenges. First, existing methods have not explicitly exploited texture details, which significantly influence the image quality. Second, multi-task methods conventionally integrate features through simple operations such as addition or concatenation, thereby diminishing the network's capacity to accurately represent distorted features. To tackle these challenges, we introduce a novel multi-task NR-IQA framework. Our framework consists of three key components: a high-frequency extraction network, a quality estimation network, and a distortion-aware network. The high-frequency extraction network is designed to guide the model's focus towards high-frequency information, which is highly related to the texture details. Meanwhile, the distortion-aware network extracts distortion-related features to distinguish different distortion types. To effectively integrate features from different tasks, a feature fusion module is developed based on an attention mechanism. Empirical results from five standard IQA databases confirm that our method not only achieves high performance but also exhibits robust generalization ability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。