arXiv:2506.02633cs.CV2025-06被引 1

用Mamba结构增强扩散模型的图像修复控制力,提升细节保真度。

ControlMambaIR: Conditional Controls with State-Space Model for Image Restoration

  • 用Mamba做条件控制网络,替代传统CNN与注意力机制。
  • 在Rain100H等数据集上LPIPS/FID指标优于现有方法。
  • 适合需要高感知质量的图像去雨、去模糊、去噪任务。

本文提出ControlMambaIR,一种新型图像修复方法,旨在解决去雨、去模糊和去噪任务中的感知质量问题。通过将Mamba网络架构与扩散模型结合,条件网络实现更精细的条件控制,从而提升图像生成过程的可控性与优化效果。为评估方法在多种图像退化条件下的鲁棒性与泛化能力,我们在Rain100H、Rain100L、GoPro和SSID等多个基准数据集上进行了大量实验。结果表明,所提方法在感知质量指标(如LPIPS和FID)上持续优于现有方法,同时在图像失真指标(如PSNR和SSIM)上保持相当水平,凸显其有效性与适应性。值得注意的是,消融实验显示,在扩散过程中直接进行噪声预测性能更优,能有效平衡噪声抑制与细节保留。此外,研究发现Mamba架构特别适合作为扩散模型的条件控制网络,在该任务中优于基于CNN和注意力的方法。总体而言,这些结果表明ControlMambaIR在应对多种图像修复感知挑战方面具有高度灵活性与有效性。

原文摘要 · Abstract (English)

This paper proposes ControlMambaIR, a novel image restoration method designed to address perceptual challenges in image deraining, deblurring, and denoising tasks. By integrating the Mamba network architecture with the diffusion model, the condition network achieves refined conditional control, thereby enhancing the control and optimization of the image generation process. To evaluate the robustness and generalization capability of our method across various image degradation conditions, extensive experiments were conducted on several benchmark datasets, including Rain100H, Rain100L, GoPro, and SSID. The results demonstrate that our proposed approach consistently surpasses existing methods in perceptual quality metrics, such as LPIPS and FID, while maintaining comparable performance in image distortion metrics, including PSNR and SSIM, highlighting its effectiveness and adaptability. Notably, ablation experiments reveal that directly noise prediction in the diffusion process achieves better performance, effectively balancing noise suppression and detail preservation. Furthermore, the findings indicate that the Mamba architecture is particularly well-suited as a conditional control network for diffusion models, outperforming both CNN- and Attention-based approaches in this context. Overall, these results highlight the flexibility and effectiveness of ControlMambaIR in addressing a range of image restoration perceptual challenges.

图像修复Mamba扩散模型条件控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。