针对人脸超分的计算瓶颈,分频处理提升效率与质量
FADPNet: Frequency-Aware Dual-Path Network for Face Super-Resolution
- 分高低频双路径处理,各用Mamba和CNN针对性优化
- 在FDDB和CelebA-HQ上分别达到29.47dB和30.12dB PSNR
- 适合资源受限场景下的人脸图像增强应用
在有限计算预算下的人脸超分辨率(FSR)仍具挑战性。现有方法常对所有面部像素同等处理,导致资源分配不佳且性能下降。卷积网络对轮廓等高频特征敏感,而Mamba在低频属性如肤色、纹理的建模上效率优于Transformer。受此启发,我们提出频率感知双路径网络FADPNet,将面部特征分解为低频与高频成分进行专用处理。低频分支采用基于Mamba的低频增强模块(LFEB),融合状态空间注意力与挤压-激励机制,恢复全局交互并突出重要通道;高频分支使用基于CNN的深度可分离位置感知注意力(DPA)模块以细化结构细节,并通过轻量级高频精修(HFR)模块进一步优化。该设计使FADPNet在图像质量与效率间取得良好平衡,超越现有方法。代码将在https://github.com/IVIPLab/FADPNet发布。
原文摘要 · Abstract (English)
Face super-resolution (FSR) under limited computational budgets remains challenging. Existing methods often treat all facial pixels equally, leading to suboptimal resource allocation and degraded performance. CNNs are sensitive to high-frequency facial features such as contours and outlines, while Mamba excels at capturing low-frequency attributes like facial color and texture with lower complexity than Transformers. Motivated by this, we propose FADPNet, a Frequency-Aware Dual-Path Network that decomposes facial features into low- and high-frequency components for dedicated processing. The low-frequency branch employs a Mamba-based Low-Frequency Enhancement Block (LFEB) that integrates state-space attention with squeeze-and-excitation to restore global interactions and emphasize informative channels. The high-frequency branch uses a CNN-based Depthwise Position-aware Attention (DPA) module to refine structural details, followed by a lightweight High-Frequency Refinement (HFR) module for further frequency-specific refinement. These designs enable FADPNet to achieve a strong balance between FSR quality and efficiency, outperforming existing methods. Codes will be available at https://github.com/IVIPLab/FADPNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。