arXiv:2603.14816cs.CV2026-03被引 1

提出M2IR框架,主动抑制图像退化传播,提升修复效果与适应性。

M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts

  • 编码阶段用Mamba风格模块逐像素调节状态,主动抑制退化
  • 解码阶段通过专家协作机制消除残留退化,恢复细节
  • 适合多场景图像修复,对复杂退化有更强适应性

尽管基于Transformer的架构在统一图像修复中占据主导地位,但它们本质上是被动响应的:仅传递退化信号而非主动抑制。缺乏显式抑制机制导致退化信号干扰特征学习,迫使解码器在去噪与保真之间权衡,增加模型复杂度并限制适应性。为此,我们提出M2IR,一种新型修复框架,在编码阶段主动调控退化传播,解码阶段高效消除残余退化。具体而言,Mamba风格变换器(MST)模块通过像素级选择性状态调制,在保留结构完整性的同时缓解退化。同时,自适应退化专家协同(ADEC)模块利用由DA-CLIP驱动的路由器引导的退化特定专家,并辅以共享专家,通过定向协同修复消除残余退化。结合MST块与ADEC模块,M2IR实现从被动反应到主动控制退化的转变,有效利用学习表征,在多样化的统一图像修复基准上实现更优泛化性、更强适应性及精细细节的精准恢复。代码已开源。

原文摘要 · Abstract (English)

While Transformer-based architectures have dominated recent advances in all-in-one image restoration, they remain fundamentally reactive: propagating degradations rather than proactively suppressing them. In the absence of explicit suppression mechanisms, degraded signals interfere with feature learning, compelling the decoder to balance artifact removal and detail preservation, thereby increasing model complexity and limiting adaptability. To address these challenges, we propose M2IR, a novel restoration framework that proactively regulates degradation propagation during the encoding stage and efficiently eliminates residual degradations during decoding. Specifically, the Mamba-Style Transformer (MST) block performs pixel-wise selective state modulation to mitigate degradations while preserving structural integrity. In parallel, the Adaptive Degradation Expert Collaboration (ADEC) module utilizes degradation-specific experts guided by a DA-CLIP-driven router and complemented by a shared expert to eliminate residual degradations through targeted and cooperative restoration. By integrating the MST block and ADEC module, M2IR transitions from passive reaction to active degradation control, effectively harnessing learned representations to achieve superior generalization, enhanced adaptability, and refined recovery of fine-grained details across diverse all-in-one image restoration benchmarks. Our source codes are available at https://github.com/Im34v/M2IR.

图像修复主动抑制专家协同Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。