arXiv:2511.06721cs.CV2025-11中稿 · ed被引 1

从单张头像图生成高保真风格化与写实纹理,解决风格不一致问题

AvatarTex: High-Fidelity Facial Texture Reconstruction from Single-Image Stylized Avatars

  • 三阶段扩散-生成对抗网络融合架构,分步修复、优化与增强纹理
  • 在2万张多风格纹理数据集上实现最新性能,保持几何与风格一致性
  • 适合数字人、虚拟偶像等需高质量面部纹理的应用场景

我们提出AvatarTex,一个从单张图像生成高保真风格化与写实面部纹理的框架。现有方法在处理风格化头像时受限于缺乏多样化的多风格数据集,且难以维持非标准纹理下的几何一致性。为解决此问题,AvatarTex引入创新的三阶段扩散到生成对抗网络(GAN)流程:首先通过基于扩散模型的修补完成缺失纹理区域;其次利用基于GAN的潜在空间优化提升风格与结构一致性;最后通过扩散模型重绘增强细节。为满足数据需求,我们构建了TexHub,一个包含20,000张高分辨率多风格UV纹理的集合,具备精确的UV对齐布局。结合TexHub与结构化扩散-生成对抗网络流程,AvatarTex在多风格面部纹理重建任务中达到新基准。TexHub将在论文发表后公开,以推动该领域后续研究。

原文摘要 · Abstract (English)

We present AvatarTex, a high-fidelity facial texture reconstruction framework capable of generating both stylized and photorealistic textures from a single image. Existing methods struggle with stylized avatars due to the lack of diverse multi-style datasets and challenges in maintaining geometric consistency in non-standard textures. To address these limitations, AvatarTex introduces a novel three-stage diffusion-to-GAN pipeline. Our key insight is that while diffusion models excel at generating diversified textures, they lack explicit UV constraints, whereas GANs provide a well-structured latent space that ensures style and topology consistency. By integrating these strengths, AvatarTex achieves high-quality topology-aligned texture synthesis with both artistic and geometric coherence. Specifically, our three-stage pipeline first completes missing texture regions via diffusion-based inpainting, refines style and structure consistency using GAN-based latent optimization, and enhances fine details through diffusion-based repainting. To address the need for a stylized texture dataset, we introduce TexHub, a high-resolution collection of 20,000 multi-style UV textures with precise UV-aligned layouts. By leveraging TexHub and our structured diffusion-to-GAN pipeline, AvatarTex establishes a new state-of-the-art in multi-style facial texture reconstruction. TexHub will be released upon publication to facilitate future research in this field.

面部纹理生成对抗网络扩散模型数字人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。