DEFNet通过多任务学习提升图像质量评估的鲁棒性与可靠性。
DEFNet: Multitasks-based Deep Evidential Fusion Network for Blind Image Quality Assessment
- 引入场景和失真类型分类任务,增强特征表达能力。
- 融合局部细节与全局上下文信息,提升表征丰富度。
- 基于证据学习估计不确定性,适合复杂真实场景应用。
盲图像质量评估(BIQA)方法常借助辅助任务提升性能,但现有方法因融合不足且缺乏灵活的不确定性估计,表现受限。为此,我们提出基于多任务的深度证据融合网络(DEFNet),通过场景分类与失真类型分类任务进行多任务优化。设计了一种可信信息融合策略:先在子区域间融合多样特征以增强信息量,再通过平衡细粒度细节与粗粒度上下文实现局部-全局融合。此外,DEFNet采用受证据学习启发的不确定性估计技术,结合正态逆伽马分布混合模型。在合成与真实失真数据集上的大量实验表明,该框架具备优异的有效性与鲁棒性。进一步评估与分析凸显其强大的泛化能力及对未见场景的适应性。
原文摘要 · Abstract (English)
Blind image quality assessment (BIQA) methods often incorporate auxiliary tasks to improve performance. However, existing approaches face limitations due to insufficient integration and a lack of flexible uncertainty estimation, leading to suboptimal performance. To address these challenges, we propose a multitasks-based Deep Evidential Fusion Network (DEFNet) for BIQA, which performs multitask optimization with the assistance of scene and distortion type classification tasks. To achieve a more robust and reliable representation, we design a novel trustworthy information fusion strategy. It first combines diverse features and patterns across sub-regions to enhance information richness, and then performs local-global information fusion by balancing fine-grained details with coarse-grained context. Moreover, DEFNet exploits advanced uncertainty estimation technique inspired by evidential learning with the help of normal-inverse gamma distribution mixture. Extensive experiments on both synthetic and authentic distortion datasets demonstrate the effectiveness and robustness of the proposed framework. Additional evaluation and analysis are carried out to highlight its strong generalization capability and adaptability to previously unseen scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。