通过注意力引导多尺度交互,提升人脸超分辨率效果
Attention-Guided Multi-scale Interaction Network for Face Super-Resolution
- 设计局部-全局特征交互模块,融合不同感受野的特征
- 引入选择性核注意力融合机制,自适应优化多尺度特征
- 在保持低计算量前提下,显著提升人脸超分质量
近期,基于卷积神经网络(CNN)与变换器(Transformer)混合的网络在人脸超分辨率(FSR)任务中表现优异。由于此类网络包含大量不同尺度的特征,如何有效融合这些多尺度特征并促进其互补性,对提升性能至关重要。然而,现有方法仅简单结合CNN与Transformer,忽略了这一关键问题。为此,我们提出一种注意力引导的多尺度交互网络(AMINet),整合局部与全局特征交互,以及编码器-解码器阶段的特征交互。具体地,提出局部与全局特征交互模块(LGFI),通过残差深度特征提取模块(RDFE)获取不同感受野的局部特征,并与全局特征进行融合;同时设计选择性核注意力融合模块(SKAF),在LGFI及编码器-解码器阶段自适应选择最优特征融合方式。该设计使多尺度特征在模块内部及编码器-解码器间自由流动,增强特征互补性,从而提升超分辨率效果。大量实验表明,本方法在计算开销更低、推理更快的前提下,持续实现优异性能。
原文摘要 · Abstract (English)
Recently, CNN and Transformer hybrid networks demonstrated excellent performance in face super-resolution (FSR) tasks. Since numerous features at different scales in hybrid networks, how to fuse these multiscale features and promote their complementarity is crucial for enhancing FSR. However, existing hybrid network-based FSR methods ignore this, only simply combining the Transformer and CNN. To address this issue, we propose an attention-guided Multiscale interaction network (AMINet), which incorporates local and global feature interactions, as well as encoder-decoder phase feature interactions. Specifically, we propose a Local and Global Feature Interaction Module (LGFI) to promote the fusion of global features and the local features extracted from different receptive fields by our Residual Depth Feature Extraction Module (RDFE). Additionally, we propose a Selective Kernel Attention Fusion Module (SKAF) to adaptively select fusions of different features within the LGFI and encoder-decoder phases. Our above design allows the free flow of multiscale features from within modules and between the encoder and decoder, which can promote the complementarity of different scale features to enhance FSR. Comprehensive experiments confirm that our method consistently performs well with less computational consumption and faster inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。