arXiv:2608.09482cs.CVcs.AI2026-08中稿 · ACMMM2026 as Oral …

像素级引导的图像恢复,让不同区域按需修复

Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance

论文配图:Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance
图 1 · 摘自论文原文
  • 按像素生成视觉提示,实现细粒度修复控制
  • 在多个任务上均超越现有方法,提升显著
  • 适合需要精准修复复杂退化的实际场景

全功能图像恢复是一项统一的低层视觉任务,旨在使用单一模型从受多种类型和程度退化影响的输入中恢复高质量图像。近期工作通过学习退化自适应提示或网络结构取得了显著进展,但这些方法通常在整个图像上应用统一的恢复策略,忽略了不同区域可能遭受不同类型的退化且严重程度各异的事实。为此,我们提出在像素级别进行恢复,从而实现更精细、更精确的控制。具体而言,我们提出MGN-AIR,一种用于全功能图像恢复的新型像素级恢复框架。该方法首先学习估计像素级视觉提示,然后结合文本和视觉提示,为模型提供全局与局部退化线索,指导每个像素处的观察位置与修复方式。我们在多个全功能图像恢复基准上进行了广泛实验,涵盖去噪、去雨、去模糊、去雾、去雪及低光增强等广泛任务。实验结果表明,所提方法在各项任务中均持续且显著优于现有方法。

原文摘要 · Abstract (English)

All-in-one image restoration is a unified low-level vision task that aims to effectively recover high-quality images from inputs degraded by various types and levels of corruption using a single model. Recent works have achieved remarkable progress by learning degradation-adaptive prompts or network architectures. However, these methods typically apply a uniform restoration strategy across the entire image, neglecting the fact that different regions may suffer from distinct degradation types and varying degrees of severity. In contrast, we propose to perform restoration at the pixel level, thereby enabling more fine-grained and precise control over the restoration process. Specifically, we present MGN-AIR, a novel pixel-level restoration framework for all-in-one image restoration. Our approach first learns to estimate a pixel-level visual prompt. Then, it leverages both textual and visual prompts to provide global and local degradation cues, guiding the model on where to look and how to restore at each pixel. We conduct extensive experiments on multiple all-in-one image restoration benchmarks, covering a wide range of tasks including denoising, deraining, deblurring, dehazing, desnowing, and low-light enhancement. Experimental results demonstrate that our proposed method consistently and significantly outperforms existing approaches.

图像恢复像素级多模态端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。