用三重感知机制实现高效图像去雾,兼顾质量与速度。
Fourier-RWKV: A Multi-State Perception Network for Efficient Image Dehazing
- 设计多状态感知框架,融合空间、频域与语义关系三种感知方式。
- 在多个数据集上达到领先性能,计算复杂度保持线性增长。
- 适合需要实时去雾的自动驾驶、无人机等场景应用。
图像去雾对可靠视觉感知至关重要,但在真实世界的非均匀雾霾条件下仍具挑战性。尽管基于Transformer的方法擅长捕捉全局上下文,但其二次计算复杂度限制了实时部署。为此,我们提出傅里叶受控权重键值(Fourier-RWKV)框架,基于多状态感知范式,以线性复杂度实现全面的雾霾退化建模。该模型通过三种不同感知状态协同工作:(1) 空间形态感知,由可变形四向标记移位(DQ-Shift)实现,动态调整感受野以适应局部雾霾变化;(2) 频域感知,在傅里叶混合块中将RWKV的核心WKV注意力机制从空间域扩展至傅里叶域,保留长程依赖性以支持全局雾霾估计,同时缓解空间衰减;(3) 语义关系感知,通过语义桥模块(SBM)结合动态语义核融合(DSK-Fusion),精确对齐编码器与解码器特征并抑制伪影。在多个基准上的大量实验表明,Fourier-RWKV在多样雾霾场景下均达到顶尖性能,同时显著降低计算开销,实现了重建质量与实际效率之间的良好权衡。代码已公开:https://github.com/Dilizlr/Fourier-RWKV。
原文摘要 · Abstract (English)
Image dehazing is crucial for reliable visual perception, yet it remains highly challenging under real-world non-uniform haze conditions. Although Transformer-based methods excel at capturing global context, their quadratic computational complexity hinders real-time deployment. To address this, we propose Fourier Receptance Weighted Key Value (Fourier-RWKV), a novel dehazing framework based on a Multi-State Perception paradigm. The model achieves comprehensive haze degradation modeling with linear complexity by synergistically integrating three distinct perceptual states: (1) Spatial-form Perception, realized through the Deformable Quad-directional Token Shift (DQ-Shift) operation, which dynamically adjusts receptive fields to accommodate local haze variations; (2) Frequency-domain Perception, implemented within the Fourier Mix block, which extends the core WKV attention mechanism of RWKV from the spatial domain to the Fourier domain, preserving the long-range dependencies essential for global haze estimation while mitigating spatial attenuation; (3) Semantic-relation Perception, facilitated by the Semantic Bridge Module (SBM), which utilizes Dynamic Semantic Kernel Fusion (DSK-Fusion) to precisely align encoder-decoder features and suppress artifacts. Extensive experiments on multiple benchmarks demonstrate that Fourier-RWKV delivers state-of-the-art performance across diverse haze scenarios while significantly reducing computational overhead, establishing a favorable trade-off between restoration quality and practical efficiency. Code is available at: https://github.com/Dilizlr/Fourier-RWKV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。