轻量级水下图像增强模型,实时运行且效果领先。
Real-Time Underwater Image Enhancement via Frequency-Guided Dual-Path Attention

- 结合频域先验与双路径注意力,兼顾速度与质量
- 仅4.23K参数,推理速度超600帧/秒
- 适合移动端和机器人实时水下视觉应用
实时水下图像增强对移动水下摄影和自主机器人系统至关重要,实际部署通常要求低延迟和小模型以适应计算资源受限场景。近期基于结构重参数化的超轻量级CNN虽满足此需求,但仅在空间域操作,忽略了水下退化问题的频率敏感性。为此,我们提出一种轻量级水下图像增强框架,包含两个核心组件:带有固定DCT先验的多分支可重参数化卷积(MBRConv-DCT),在训练中注入结构化方向频域先验;以及频域引导的双路径注意力(FGDPA)模块,通过双路径设计融合空间与谱域线索实现自适应特征调制。两者均完全兼容结构重参数化:卷积分支在重参数化后不引入额外推理开销,注意力模块仅增加极小计算量。实验表明,本模型仅用4.23K参数和600+ FPS,即达到当前最优性能,优于许多更大模型的定量指标与视觉质量。代码已公开于https://github.com/LethyZhang/FGDPA。
原文摘要 · Abstract (English)
Real-time underwater image enhancement (UIE) is crucial for mobile underwater photography and autonomous robotic systems, where practical deployment typically requires low latency and compact models under constrained computational resources. Recent ultra-lightweight CNNs based on structural re-parameterization meet these constraints but operate purely in the spatial domain, ignoring the frequency-sensitive nature of underwater degradation. To address this, we propose a lightweight UIE framework that integrates two key components: a Multi-Branch Reparameterizable Convolution with Fixed DCT Priors (MBRConv-DCT) that injects structured directional frequency priors during training, and a Frequency-Guided Dual-Path Attention (FGDPA) module that fuses spatial and spectral cues via a dual-path design for adaptive feature modulation. Both components are fully compatible with structural re-parameterization: the convolution branch introduces zero additional inference cost after re-parameterization, while the attention module incurs only a minimal computational overhead. Experiments show our model achieves state-of-the-art performance with only 4.23K parameters and 600+ FPS, outperforming much larger methods in both quantitative metrics and visual quality. Code is available at https://github.com/LethyZhang/FGDPA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。