提出可局部编辑的3D头像建模方法imHead,突破传统模型限制。
ImHead: A Large-scale Implicit Morphable Model for Localized Head Modeling
- 用中间区域潜空间实现局部编辑,保持紧凑身份潜空间
- 基于4000个不同身份的大型数据集训练,支持多样表情与身份
- 可解释性强,适合需要精细人脸调整的应用场景
近年来,3D可变形模型(3DMMs)已成为生成高表达力3D虚拟形象的主流方法。然而,由于依赖严格拓扑结构和线性特性,传统方法难以刻画复杂完整的头部形态。随着深度隐式函数的发展,本文提出imHead,一种新型隐式3DMM,不仅能建模高表达力的3D头像,还可实现面部特征的局部编辑。以往方法将潜在空间直接划分为局部组件并辅以身份编码,导致潜空间过大。本文保留单一紧凑的身份潜空间,引入中间区域特定的潜表示,以支持局部修改。为训练imHead,我们构建了一个包含4000个不同身份的大规模数据集,推动了大规模3D头像建模的发展。一系列实验表明,该模型在表征多样化身份与表情方面优于先前方法,同时提供了可解释的3D人脸操控方案,支持用户进行局部编辑。
原文摘要 · Abstract (English)
Over the last years, 3D morphable models (3DMMs) have emerged as a state-of-the-art methodology for modeling and generating expressive 3D avatars. However, given their reliance on a strict topology, along with their linear nature, they struggle to represent complex full-head shapes. Following the advent of deep implicit functions, we propose imHead, a novel implicit 3DMM that not only models expressive 3D head avatars but also facilitates localized editing of the facial features. Previous methods directly divided the latent space into local components accompanied by an identity encoding to capture the global shape variations, leading to expensive latent sizes. In contrast, we retain a single compact identity space and introduce an intermediate region-specific latent representation to enable local edits. To train imHead, we curate a large-scale dataset of 4K distinct identities, making a step-towards large scale 3D head modeling. Under a series of experiments we demonstrate the expressive power of the proposed model to represent diverse identities and expressions outperforming previous approaches. Additionally, the proposed approach provides an interpretable solution for 3D face manipulation, allowing the user to make localized edits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。