让虚拟头像的头发能真实随风摆动,突破传统僵硬模型限制。
PhysHead: Simulation-Ready Gaussian Head Avatars
- 用3D高斯分层表示头像,结合参数化网格与发丝建模
- 可直接在物理引擎中模拟风动效果,生成逼真动态头发
- 适合需要高保真表情与动态头发的虚拟人场景
真实数字头像需具备生动自然的头发运动;然而现有方法多假设头发刚性移动,难以分离头与发,常将其视为简单外壳,无法捕捉其真实体积行为。本文提出PhysHead,一种基于多视角视频学习的可动画化头像混合表示。核心采用基于3D高斯的分层结构,将头颅建模为参数化网格,头发则以发丝形式表示,可直接通过物理引擎模拟。外观模型使用附着于头网和发段的高斯原语。该表示支持生成具有风吹等动态效果的写实头像,克服了现有方法中头发僵硬的局限。为实现动画,我们引入视觉语言模型(VLM)生成动态训练序列中被遮挡区域的外观。定量与定性评估表明,本方法不仅能实现表达与相机控制,还能合成符合物理规律的头发运动。
原文摘要 · Abstract (English)
Realistic digital avatars require expressive and dynamic hair motion; however, most existing head avatar methods assume rigid hair movement. These methods often fail to disentangle hair from the head, representing it as a simple outer shell and failing to capture its natural volumetric behavior. In this paper, we address these limitations by introducing PhysHead, a hybrid representation for animatable head avatars with realistic hair dynamics learned from multi-view video. At the core is a 3D Gaussian-based layered representation of the head. Our approach combines a 3D parametric mesh for the head with strand-based hair, which can be directly simulated using physics engines. For the appearance model, we employ Gaussian primitives attached to both the head mesh and hair segments. This representation enables the creation of photorealistic head avatars with dynamic hair behavior, such as wind-blown motion, overcoming the constraints of rigid hair in existing methods. However, these animation capabilities also require new training schemes. In particular, we propose the use of VLM-based models to generate appearance of regions that are occluded in the dynamic training sequences. In quantitative and qualitative studies, we demonstrate the capabilities of the proposed model and compare it with existing baselines. We show that our method can synthesize physically plausible hair motion besides expression and camera control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。