用变分贝叶斯建模雾霾退化过程,同时学习清晰图与透射率图。
Deep Variational Bayesian Modeling of Haze Degradation Process
- 将清晰图像和透射率图作为潜在变量,用神经网络建模后验分布。
- 基于物理模型构建新目标函数,提升去雾与透射率估计的协同效果。
- 可无缝融合现有去雾模型,跨数据集稳定提升性能,推理无额外开销。
近年来多数方法依赖神经网络的表达能力,却忽略了雾霾退化中的关键因素,如透射率(光线沿距离到达观察者的比例)和大气光。这些因素通常未知,导致去雾问题病态且存在固有不确定性。为此,我们提出一种用于单张图像去雾的变分贝叶斯框架,将干净图像和透射率图均作为潜在变量,其后验分布分别由去雾网络和透射率网络参数化。基于雾霾退化的物理模型,该框架导出新的目标函数,促进两者协同训练,从而提升彼此性能。推理时,去雾网络可独立估计干净图像,无需依赖透射率估计,不增加计算开销。此外,本框架具备模型无关性,可无缝集成至其他现有去雾网络,在多个数据集和模型上一致提升性能。
原文摘要 · Abstract (English)
Relying on the representation power of neural networks, most recent works have often neglected several factors involved in haze degradation, such as transmission (the amount of light reaching an observer from a scene over distance) and atmospheric light. These factors are generally unknown, making dehazing problems ill-posed and creating inherent uncertainties. To account for such uncertainties and factors involved in haze degradation, we introduce a variational Bayesian framework for single image dehazing. We propose to take not only a clean image and but also transmission map as latent variables, the posterior distributions of which are parameterized by corresponding neural networks: dehazing and transmission networks, respectively. Based on a physical model for haze degradation, our variational Bayesian framework leads to a new objective function that encourages the cooperation between them, facilitating the joint training of and thereby boosting the performance of each other. In our framework, a dehazing network can estimate a clean image independently of a transmission map estimation during inference, introducing no overhead. Furthermore, our model-agnostic framework can be seamlessly incorporated with other existing dehazing networks, greatly enhancing the performance consistently across datasets and models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。