arXiv:2409.16863cs.CV2024-09SIGGRAPH被引 12

统一重建单图中编发与非编发的3D发型,效果领先。

Towards Unified 3D Hair Reconstruction from Single-View Portraits

  • 用合成数据学两种扩散先验,统一处理各类发型。
  • 通过视图与像素级优化,实现高精度3D头发重建。
  • 即使在真实图像上也表现良好,适合影视与虚拟人应用。

单视角3D头发重建因发型变化多样而困难。现有顶尖方法专精于无编发发型,常将编发视为失败案例,因复杂发型难以建立有效先验。本文提出统一管道,首次实现单图下编发与非编发3D头发的联合重建。我们构建了大规模合成多视角头发数据集SynMvHair,涵盖多种编发与非编发样式,并学习两个针对头发的扩散先验。随后,基于3D高斯表示,通过视图级与像素级高斯优化模块,从先验中重构3D头发。实验表明,该方法在复杂发型重建上达到当前最优性能,且虽基于合成数据训练,仍具备对真实图像的良好泛化能力。

原文摘要 · Abstract (English)

Single-view 3D hair reconstruction is challenging, due to the wide range of shape variations among diverse hairstyles. Current state-of-the-art methods are specialized in recovering un-braided 3D hairs and often take braided styles as their failure cases, because of the inherent difficulty to define priors for complex hairstyles, whether rule-based or data-based. We propose a novel strategy to enable single-view 3D reconstruction for a variety of hair types via a unified pipeline. To achieve this, we first collect a large-scale synthetic multi-view hair dataset SynMvHair with diverse 3D hair in both braided and un-braided styles, and learn two diffusion priors specialized on hair. Then we optimize 3D Gaussian-based hair from the priors with two specially designed modules, i.e. view-wise and pixel-wise Gaussian refinement. Our experiments demonstrate that reconstructing braided and un-braided 3D hair from single-view images via a unified approach is possible and our method achieves the state-of-the-art performance in recovering complex hairstyles. It is worth to mention that our method shows good generalization ability to real images, although it learns hair priors from synthetic data.

3D重建头发生成扩散模型单图生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。