arXiv:2601.01406cs.CVcs.AI2026-01

用关键点引导的Transformer,让模糊人脸修复更像本人。

SwinIFS: Landmark Guided Swin Transformer For Identity Preserving Face Super Resolution

  • 引入面部关键点热图,让网络早期就关注重要区域
  • 在8倍放大下仍能恢复清晰结构,身份保留率显著提升
  • 兼顾效果与效率,适合监控、修复等实际场景

人脸超分辨率旨在从严重退化的低分辨率输入中恢复高质量人脸图像,但因细节和身份特征丢失而面临挑战。本文提出SwinIFS,一种基于关键点引导的超分辨率框架,通过融合结构先验与分层注意力机制,在中等和极端放大倍数下实现身份保持的重建。该方法将密集高斯热图形式的关键面部标志点融入输入表示,使网络从处理初期即聚焦于语义重要的面部区域。采用紧凑的Swin Transformer主干网络,既能捕捉长程上下文信息,又保留局部几何结构,从而恢复细微纹理并维持全局结构一致性。在CelebA基准上的大量实验表明,SwinIFS在感知质量、图像锐度和身份保留方面均表现优异;即使在8倍放大时仍能生成更逼真的结果,多数方法在此条件下已无法恢复有效结构。SwinIFS在重建精度与计算效率间取得良好平衡,适用于人脸增强、监控和数字修复等实际应用。代码、模型权重与结果已开源。

原文摘要 · Abstract (English)

Face super-resolution aims to recover high-quality facial images from severely degraded low-resolution inputs, but remains challenging due to the loss of fine structural details and identity-specific features. This work introduces SwinIFS, a landmark-guided super-resolution framework that integrates structural priors with hierarchical attention mechanisms to achieve identity-preserving reconstruction at both moderate and extreme upscaling factors. The method incorporates dense Gaussian heatmaps of key facial landmarks into the input representation, enabling the network to focus on semantically important facial regions from the earliest stages of processing. A compact Swin Transformer backbone is employed to capture long-range contextual information while preserving local geometry, allowing the model to restore subtle facial textures and maintain global structural consistency. Extensive experiments on the CelebA benchmark demonstrate that SwinIFS achieves superior perceptual quality, sharper reconstructions, and improved identity retention; it consistently produces more photorealistic results and exhibits strong performance even under $8\times$ magnification, where most methods fail to recover meaningful structure. SwinIFS also provides an advantageous balance between reconstruction accuracy and computational efficiency, making it suitable for real-world applications in facial enhancement, surveillance, and digital restoration. Our code, model weights, and results are available at https://github.com/Habiba123-stack/SwinIFS.

人脸超分Transformer身份保持关键点引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。