用状态空间模型和扩散先验提升极端曝光图像的细节恢复能力
OSMamba: Omnidirectional Spectral Mamba with Dual-Domain Prior Generator for Exposure Correction
- 结合Mamba与扩散模型,双域生成先验以捕捉频谱长程依赖
- 在多曝光数据集上达到当前最优,显著改善过曝/欠曝区域细节
- 适合需要高保真图像修复的应用场景,如摄影后期与医学成像
曝光校正一直是计算机视觉与图像处理中的基础问题。尽管基于频域的方法取得了显著进展,但在极端曝光条件下的复杂真实场景中仍表现不佳,主要源于局部卷积感受野难以建模频谱中的长程依赖,且非生成式学习范式无法有效恢复严重退化区域的丢失细节。本文提出一种新型曝光校正网络OSMamba,融合状态空间模型与生成式扩散模型的优势以克服上述局限。具体而言,OSMamba引入全景频谱扫描机制,将Mamba适配至频域,从而在深度图像特征的幅度与相位谱中全面捕获长程依赖,提升光照校正与结构恢复效果。此外,我们设计了双域先验生成器,从正常曝光图像中学习并生成无退化的扩散先验,包含严重欠曝与过曝区域的正确信息,以实现更优的细节重建。在多个多曝光与混合曝光数据集上的大量实验表明,所提OSMamba在定量与定性指标上均达到当前最优性能。
原文摘要 · Abstract (English)
Exposure correction is a fundamental problem in computer vision and image processing. Recently, frequency domain-based methods have achieved impressive improvement, yet they still struggle with complex real-world scenarios under extreme exposure conditions. This is due to the local convolutional receptive fields failing to model long-range dependencies in the spectrum, and the non-generative learning paradigm being inadequate for retrieving lost details from severely degraded regions. In this paper, we propose Omnidirectional Spectral Mamba (OSMamba), a novel exposure correction network that incorporates the advantages of state space models and generative diffusion models to address these limitations. Specifically, OSMamba introduces an omnidirectional spectral scanning mechanism that adapts Mamba to the frequency domain to capture comprehensive long-range dependencies in both the amplitude and phase spectra of deep image features, hence enhancing illumination correction and structure recovery. Furthermore, we develop a dual-domain prior generator that learns from well-exposed images to generate a degradation-free diffusion prior containing correct information about severely under- and over-exposed regions for better detail restoration. Extensive experiments on multiple-exposure and mixed-exposure datasets demonstrate that the proposed OSMamba achieves state-of-the-art performance both quantitatively and qualitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。