受人眼视觉启发,用分层策略实现图像修复的统一框架。
ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restoration
- 基于人眼视觉机制,先全局评估再局部修复
- 在多个数据集上优于现有方法,细节恢复更真实
- 适合处理复杂真实世界图像退化问题
全功能图像修复(AiOIR)已取得显著进展,能有效应对复杂的现实退化。然而,现有方法多依赖特定退化的表征,常导致过度平滑和伪影。为此,我们提出ClearAIR,一种受人类视觉感知(HVP)启发的新型AiOIR框架,采用分层、粗到细的修复策略。首先,利用多模态大语言模型(MLLM)驱动的图像质量评估(IQA)模型进行整体评价,通过跨模态理解更准确刻画复合退化。在此基础上,引入区域感知与任务识别流程:先生成粗粒度语义提示,再由退化感知模块隐式捕捉区域特异性退化特征,实现更精准的局部修复。最后,提出内部线索复用机制,在自监督模式下挖掘并利用图像自身内在信息,显著提升细节恢复能力。实验表明,ClearAIR在多种合成与真实世界数据集上均表现优异。
原文摘要 · Abstract (English)
All-in-One Image Restoration (AiOIR) has advanced significantly, offering promising solutions for complex real-world degradations. However, most existing approaches rely heavily on degradation-specific representations, often resulting in oversmoothing and artifacts. To address this, we propose ClearAIR, a novel AiOIR framework inspired by Human Visual Perception (HVP) and designed with a hierarchical, coarse-to-fine restoration strategy. First, leveraging the global priority of early HVP, we employ a Multimodal Large Language Model (MLLM)-based Image Quality Assessment (IQA) model for overall evaluation. Unlike conventional IQA, our method integrates cross-modal understanding to more accurately characterize complex, composite degradations. Building upon this overall assessment, we then introduce a region awareness and task recognition pipeline. A semantic cross-attention, leveraging semantic guidance unit, first produces coarse semantic prompts. Guided by this regional context, a degradation-aware module implicitly captures region-specific degradation characteristics, enabling more precise local restoration. Finally, to recover fine details, we propose an internal clue reuse mechanism. It operates in a self-supervised manner to mine and leverage the intrinsic information of the image itself, substantially enhancing detail restoration. Experimental results show that ClearAIR achieves superior performance across diverse synthetic and real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。