arXiv:2605.14821cs.CV2026-05

用高维特征增强人脸修复,让模糊图像恢复更逼真。

HDRFace: Rethinking Face Restoration with High-Dimensional Representation

论文配图:HDRFace: Rethinking Face Restoration with High-Dimensional Representation
图 1 · 摘自论文原文
  • 用预训练编码器提取输入与中间结果的细粒度面部特征
  • 结构-细节自适应融合机制提升整体一致性与细节还原
  • 适配多个生成模型,修复效果稳定且通用性强

复杂退化下的人脸修复仍是一个病态逆问题,因信息严重丢失难以恢复。尽管扩散模型具备强生成先验,但多数方法仅依赖低质量输入,难以在重度退化下恢复身份关键细节。本文提出HDRFace,一种基于高维表征的人脸修复框架,在不修改生成主干的前提下,将语义丰富的先验注入条件流。首先使用现成修复器获得结构可靠的中间结果,再通过预训练高维特征编码器从低质输入和中间结果中提取细粒度面部表征,并作为额外条件输入生成过程。进一步提出SDFM结构-细节感知自适应融合机制,在结构建模阶段强调全局约束,在细节合成阶段强化表征引导,平衡结构一致性和细节保真度。为验证方法泛化能力,我们在SD V2.1-base和Qwen-Image两个生成模型上实现该框架,结果均显示跨架构稳定且连贯的性能提升。

原文摘要 · Abstract (English)

Face restoration under complex degradations still remains an ill-posed inverse problem due to severe information loss. Although diffusion models benefit from strong generative priors, most methods still condition only on low-quality inputs, making it difficult to recover identity-critical details under heavy degradations. In this work, we propose HDRFace, a High-Dimensional Representation conditioned Face restoration framework that injects semantically rich priors into the conditional flow without modifying the generative backbone. Our pipeline first obtains a structurally reliable intermediate restoration with an off-the-shelf restorer, then uses a pretrained high-dimensional feature encoder to extract fine-grained facial representations from both the low-quality input and the intermediate result, and injects them as additional conditions for generation. We further introduce SDFM, a Structure-Detail aware adaptive Fusion Mechanism that emphasizes global constraints during structure modeling and strengthens representation guidance during detail synthesis, balancing structural consistency and detail fidelity. To validate the generalization ability of our method, we implement the proposed framework on two generative models, SD V2.1-base and Qwen-Image, and consistently observe stable and coherent performance gains across different architectures.

人脸修复扩散模型高维表征结构融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。