arXiv:2502.10714cs.CV2025-02AAAI被引 8

首次建模夜间镜头光晕的相互依赖关系,实现多类型光晕联合去除。

Disentangle Nighttime Lens Flares: Self-supervised Generation-based Lens Flare Removal

  • 基于物理先验分解夜间光晕与反射光晕,分离处理
  • 自监督训练,无需预训练,可同时处理多种光晕类型
  • 适用于真实场景中多类型光晕共存的复杂情况

镜头光晕由传感器阵列内的光反射和折射产生,类型多样,包括辉光、漫射眩光、反射光晕等。现有方法仅针对单一类型设计,忽视了真实场景中多种光晕共现的现象,例如同一光源产生的辉光与位移反射同时存在。简单组合单类型去除方法无法有效解决此类问题,因为共现光晕源于同一光源,在同一传感器阵列中同步生成,具有复杂耦合关系而非简单叠加。为此,本文首次提出夜间镜头光晕生成模型,学习成像平面上光晕间的内在物理关联。基于此物理模型,构建自监督生成式光晕去除网络SGLFR-Net,无需预训练。其中,辉光在基于点扩散函数渲染先验的PSF渲染网络(PSFR-Net)中分离;反射光晕则通过基于纹理先验的反射光晕去除网络(TPRR-Net)建模。实验证明该方法在联合与单类型光晕去除任务中均有效。

原文摘要 · Abstract (English)

Lens flares arise from light reflection and refraction within sensor arrays, whose diverse types include glow, veiling glare, reflective flare and so on. Existing methods are specialized for one specific type only, and overlook the simultaneous occurrence of multiple typed lens flares, which is common in the real-world, e.g. coexistence of glow and displacement reflections from the same light source. These co-occurring lens flares cannot be effectively resolved by the simple combination of individual flare removal methods, since these coexisting flares originates from the same light source and are generated simultaneously within the same sensor array, exhibit a complex interdependence rather than simple additive relation. To model this interdependent flare relationship, our Nighttime Lens Flare Formation model is the first attempt to learn the intrinsic physical relationship between flares on the imaging plane. Building on this physical model, we introduce a solution to this joint flare removal task named Self-supervised Generation-based Lens Flare Removal Network (SGLFR-Net), which is self-supervised without pre-training. Specifically, the nighttime glow is detangled in PSF Rendering Network(PSFR-Net) based on PSF Rendering Prior, while the reflective flare is modelled in Texture Prior Based Reflection Flare Removal Network (TPRR-Net). Empirical evaluations demonstrate the effectiveness of the proposed method in both joint and individual glare removal tasks.

图像去光晕自监督学习物理建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。