提出多状态视角的URWKV模型,提升低光图像修复效果
URWKV: Unified RWKV Model with Multi-state Perspective for Low-light Image Restoration
- 用多状态机制捕捉复杂光照退化特征
- 在多个数据集上优于现有模型,参数量更少
- 适合需要轻量化、高适应性的低光图像处理场景
现有的低光图像增强(LLIE)及联合去模糊模型虽在预设退化下取得进展,但常受限于动态耦合的退化问题。为此,本文提出统一的接收权重键值(URWKV)模型,引入多状态视角,实现对低光图像退化的灵活高效恢复。首先,受人眼瞳孔机制启发,提出亮度自适应归一化(LAN),基于丰富的跨阶段状态动态调整归一化参数,实现场景感知的亮度调节。其次,通过指数移动平均聚合多阶段内部状态,有效捕捉细微变化,缓解单状态机制的信息丢失。为减少传统跳跃连接带来的退化影响,设计状态感知选择性融合(SSF)模块,动态对齐并整合编码器各阶段的多状态特征,选择性融合上下文信息。相比当前最优模型,本方法在多个基准上表现更优,同时显著降低参数量与计算开销。
原文摘要 · Abstract (English)
Existing low-light image enhancement (LLIE) and joint LLIE and deblurring (LLIE-deblur) models have made strides in addressing predefined degradations, yet they are often constrained by dynamically coupled degradations. To address these challenges, we introduce a Unified Receptance Weighted Key Value (URWKV) model with multi-state perspective, enabling flexible and effective degradation restoration for low-light images. Specifically, we customize the core URWKV block to perceive and analyze complex degradations by leveraging multiple intra- and inter-stage states. First, inspired by the pupil mechanism in the human visual system, we propose Luminance-adaptive Normalization (LAN) that adjusts normalization parameters based on rich inter-stage states, allowing for adaptive, scene-aware luminance modulation. Second, we aggregate multiple intra-stage states through exponential moving average approach, effectively capturing subtle variations while mitigating information loss inherent in the single-state mechanism. To reduce the degradation effects commonly associated with conventional skip connections, we propose the State-aware Selective Fusion (SSF) module, which dynamically aligns and integrates multi-state features across encoder stages, selectively fusing contextual information. In comparison to state-of-the-art models, our URWKV model achieves superior performance on various benchmarks, while requiring significantly fewer parameters and computational resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。