轻量级图像超分模型,用大核卷积实现高效非局部特征捕捉。
Large Kernel Modulation Network for Efficient Image Super-Resolution
- 纯卷积架构,通过通道混洗与注意力增强跨通道交互。
- 在Manga109数据集上比DAT-light提升0.23 dB PSNR,速度提升近4.8倍。
- 适合移动端或嵌入式设备部署,兼顾清晰度与推理速度。
资源受限场景下的图像超分辨率需要轻量模型在性能与延迟间取得平衡。卷积神经网络(CNN)虽延迟低但缺乏非局部特征建模能力,而变换器(Transformer)虽擅长非局部建模却存在推理缓慢问题。为此,本文提出纯卷积架构的大型核调制网络(LKMN),包含两个核心组件:增强型部分大核块(EPLKB)和交叉门前馈网络(CGFN)。EPLKB利用通道混洗增强跨通道交互,引入通道注意力聚焦关键信息,并在部分通道上应用大核条带卷积以低复杂度实现非局部特征提取。CGFN通过可学习缩放因子动态调节输入、局部与非局部特征间的差异,再采用交叉门策略调制并融合特征,提升互补性。大量实验表明,该方法优于现有最先进轻量级超分模型,在Manga109数据集×4放大下,LKMN-L相比DAT-light提升0.23 dB PSNR,推理速度接近4.8倍快。代码已公开于https://github.com/Supereeeee/LKMN。
原文摘要 · Abstract (English)
Image super-resolution (SR) in resource-constrained scenarios demands lightweight models balancing performance and latency. Convolutional neural networks (CNNs) offer low latency but lack non-local feature capture, while Transformers excel at non-local modeling yet suffer slow inference. To address this trade-off, we propose the Large Kernel Modulation Network (LKMN), a pure CNN-based model. LKMN has two core components: Enhanced Partial Large Kernel Block (EPLKB) and Cross-Gate Feed-Forward Network (CGFN). The EPLKB utilizes channel shuffle to boost inter-channel interaction, incorporates channel attention to focus on key information, and applies large kernel strip convolutions on partial channels for non-local feature extraction with reduced complexity. The CGFN dynamically adjusts discrepancies between input, local, and non-local features via a learnable scaling factor, then employs a cross-gate strategy to modulate and fuse these features, enhancing their complementarity. Extensive experiments demonstrate that our method outperforms existing state-of-the-art (SOTA) lightweight SR models while balancing quality and efficiency. Specifically, LKMN-L achieves 0.23 dB PSNR improvement over DAT-light on the Manga109 dataset at $\times$4 upscale, with nearly $\times$4.8 times faster. Codes are in the supplementary materials. The code is available at https://github.com/Supereeeee/LKMN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。