轻量级网络实现高效去雾,兼顾性能与低计算开销。
Distilled Pooling Transformer Encoder for Efficient Realistic Image Dehazing
- 用高效池化替代自注意力,降低计算复杂度
- 通过知识蒸馏提升语义特征学习能力
- 适配资源受限设备,适合边缘部署场景
本文提出一种轻量级神经网络DPTE-Net,用于真实场景图像去雾。尽管视觉变换器(ViTs)在多种视觉任务中表现优异,但其自注意力(SA)模块的计算复杂度随图像分辨率呈平方增长,限制了在资源受限设备上的应用。为此,DPTE-Net将传统SA模块替换为高效的池化机制,显著降低计算需求,同时保留ViTs的学习能力。为进一步增强语义特征学习,采用基于知识蒸馏的训练策略,从更大的教师网络迁移丰富知识。此外,DPTE-Net在生成对抗网络(GAN)框架中训练,利用GAN强大的图像恢复泛化能力,并引入传输感知损失函数,动态适应不同雾霾密度。在多个基准数据集上的实验表明,所提方法在保持低计算复杂度的同时,达到与先进方法相当的去雾性能,适用于资源受限的应用场景。代码已公开于https://github.com/tranleanh/dpte-net。
原文摘要 · Abstract (English)
This paper proposes a lightweight neural network designed for realistic image dehazing, utilizing a Distilled Pooling Transformer Encoder, named DPTE-Net. Recently, while vision transformers (ViTs) have achieved great success in various vision tasks, their self-attention (SA) module's complexity scales quadratically with image resolution, hindering their applicability on resource-constrained devices. To overcome this, the proposed DPTE-Net substitutes traditional SA modules with efficient pooling mechanisms, significantly reducing computational demands while preserving ViTs' learning capabilities. To further enhance semantic feature learning, a distillation-based training process is implemented which transfers rich knowledge from a larger teacher network to DPTE-Net. Additionally, DPTE-Net is trained within a generative adversarial network (GAN) framework, leveraging the strong generalization of GAN in image restoration, and employs a transmission-aware loss function to dynamically adapt to varying haze densities. Experimental results on various benchmark datasets have shown that the proposed DPTE-Net can achieve competitive dehazing performance when compared to state-of-the-art methods while maintaining low computational complexity, making it a promising solution for resource-limited applications. The code of this work is available at https://github.com/tranleanh/dpte-net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。