arXiv:2505.05376cs.CV2025-05被引 1

仅用无色3D扫描重建发丝,支持真实人物与设计模型

GeomHair: Reconstruction of Hair Strands from Colorless 3D Scans

  • 基于表面特征与神经线检测,从无色几何数据推断发丝方向
  • 在400个真实人体扫描上重建发丝,精度达复杂发型还原
  • 适配数字人、动画、CG制作,可生成图像/文本到发丝的模型

本文提出一种新方法,仅通过无色3D扫描直接重建发丝结构。针对人类头发细密复杂的特性,现有方法均依赖颜色或纹理信息,而本方法首次实现仅基于几何形状的发丝重建。核心思路是:先识别扫描表面的尖锐特征,再利用神经2D线检测器分析渲染后的阴影图,估计发丝方向;同时引入在合成发丝扫描上训练的扩散先验,结合扫描特定文本提示进行优化。该方法能准确重建简单与复杂发型。为推动研究,我们构建了公开数据集Strands400,包含400名受试者的高精度发丝几何重建结果,支持图像到发丝、文本到发丝等生成任务。本方法亦适用于设计师创建的网格资产,满足影视特效中建模-模拟-渲染的完整工作流需求。代码与数据将在https://seva100.github.io/GeomHair/ 公开。

原文摘要 · Abstract (English)

We propose a novel method that reconstructs hair strands directly from colorless 3D scans by leveraging multi-modal hair orientation extraction. Hair strand reconstruction is a fundamental problem in computer vision and graphics, essential for high-fidelity digital avatar synthesis, animation, and AR/VR applications. However, accurately recovering hair strands from raw scan data remains challenging due to the complex and fine-grained structure of human hair, and none of the existing methods operate on colorless 3D geometry alone. To address this gap, our method directly identifies sharp surface features on the scan and estimates strand orientation using a neural 2D line detector applied to the renderings of scan shading. Additionally, we incorporate a diffusion prior trained on a diverse set of synthetic hair scans, refined with a noise schedule, and adapted to the reconstructed contents via a scan-specific text prompt. We demonstrate that this combination of supervision signals enables accurate reconstruction of both simple and intricate hairstyles from geometry alone. By enabling strand extraction from 3D scans, we compile Strands400, the largest publicly available dataset of hair strands with detailed surface geometry extracted from real-world data, comprising reconstructions from 400 subjects' scans. Strands400 enables training data-driven generative models for downstream tasks such as image-to-strands and text-to-strands. Moreover, our method applies to designer mesh assets, supporting a practical CG workflow where artists model hair as meshes and need strand-level representations for simulation and rendering. All code and data will be released for research purposes on https://seva100.github.io/GeomHair/.

发丝重建3D扫描扩散模型数字人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。