arXiv:2508.02113cs.CVeess.IV2025-08中稿 · ACMMM 2025被引 5

用分层状态空间模型实现自然一致的镜头眩光消除

DeflareMamba: Hierarchical Vision Mamba for Contextually Consistent Lens Flare Removal

  • 设计分层架构,通过不同步长采样建立长程像素关联
  • 同时保留局部细节,有效去除散射与反射眩光
  • 首个将状态空间模型用于眩光去除的工作,适合图像修复与视觉理解任务

镜头眩光去除仍面临图像背景与光学眩光间信息混淆的挑战,源于光源与镜头间的复杂光学交互。尽管近期方法在分离眩光污染方面取得进展,但常因无法保持上下文一致性,导致去除不完整或不一致。为此,我们提出DeflareMamba,利用状态空间模型的高效序列建模能力,同时保留捕捉局部-全局依赖的能力。特别地,设计分层框架,通过不同步长采样建立长程像素相关性,并采用局部增强的状态空间模块以同时保持局部细节。据我们所知,这是首个将状态空间模型引入眩光去除任务的工作。大量实验表明,本方法能有效去除多种类型眩光,包括散射与反射眩光,且保持非眩光区域的自然外观。下游应用进一步验证其提升视觉目标识别与跨模态语义理解的能力。代码已公开于 https://github.com/BNU-ERC-ITEA/DeflareMamba。

原文摘要 · Abstract (English)

Lens flare removal remains an information confusion challenge in the underlying image background and the optical flares, due to the complex optical interactions between light sources and camera lens. While recent solutions have shown promise in decoupling the flare corruption from image, they often fail to maintain contextual consistency, leading to incomplete and inconsistent flare removal. To eliminate this limitation, we propose DeflareMamba, which leverages the efficient sequence modeling capabilities of state space models while maintains the ability to capture local-global dependencies. Particularly, we design a hierarchical framework that establishes long-range pixel correlations through varied stride sampling patterns, and utilize local-enhanced state space models that simultaneously preserves local details. To the best of our knowledge, this is the first work that introduces state space models to the flare removal task. Extensive experiments demonstrate that our method effectively removes various types of flare artifacts, including scattering and reflective flares, while maintaining the natural appearance of non-flare regions. Further downstream applications demonstrate the capacity of our method to improve visual object recognition and cross-modal semantic understanding. Code is available at https://github.com/BNU-ERC-ITEA/DeflareMamba.

图像修复状态空间模型眩光去除

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。