用检测器生成的热图指导轻量级网络,实现8倍超分
You Only Landmark Once: Lightweight U-Net Face Super Resolution with YOLO-World Landmark Heatmaps

- 基于YOLO-World热图生成空间权重,无须额外标注或网络
- 从16×16输入重建128×128图像,峰值达到8倍放大
- 无需对抗训练,模型轻量高效,适合部署到资源受限场景
人脸超分辨率旨在从严重退化的输入中恢复高分辨率人脸图像。在极端放大倍数下,细粒度特征常被丢失,导致重建困难。现有方法通常依赖重型网络结构、对抗训练或独立对齐网络,增加了模型复杂度和计算开销。为此,我们提出一种轻量级U-Net架构,可将严重退化的16×16输入重建为128×128图像,实现8×放大。核心贡献是无需辅助训练的监督策略,利用YOLO-World(一个开放词汇目标检测器)生成的关键面部特征热图(如眼睛、鼻子、嘴巴),将其转化为空间权重,构建热图引导损失,强化语义重要区域的重建误差。与以往需专用关键点或对齐网络的方法不同,本方法直接复用检测器输出作为监督信号,保持高效训练与推理流程。在对齐后的CelebA数据集上的实验表明,该损失持续提升定量指标,并生成更清晰、更逼真的重建结果。总体而言,轻量级网络可通过检测驱动先验实现感知上令人信服的极端放大,无需对抗训练或增加计算成本。
原文摘要 · Abstract (English)
Face image super-resolution aims to recover high-resolution facial images from severely degraded inputs. Under extreme upscaling factors, fine facial details are often lost, making accurate reconstruction challenging. Existing methods typically rely on heavy network architectures, adversarial training schemes, or separate alignment networks, increasing model complexity and computational cost. To address these issues, we propose a lightweight U-Net based-architecture designed to reconstructs $128{ \times }128$ facial images from severely degraded $16{ \times }16$ inputs, achieving an $8 \times $ magnification. A key contribution is a novel auxiliary-training-free supervision strategy that leverages heatmaps generated by YOLO-World, an open-vocabulary object detector, to localize key facial features such as eyes, nose, and mouth. These heatmaps are converted into spatial weights to form a heatmap-guided loss that emphasizes reconstruction errors in semantically important regions. Unlike prior methods that require dedicated landmark or alignment networks, our approach directly reuses detector outputs as supervision, maintaining an efficient training and inference pipeline. Experiments on the aligned CelebA dataset demonstrate that the proposed loss consistently improves quantitative metrics and produces sharper, more realistic reconstructions. Overall, our results show that lightweight networks can effectively exploit detection-driven priors for perceptually convincing extreme upscaling, without adversarial training or increased computational cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。