用颅骨雕刻法精准分离面部表情与头骨运动,提升虚拟形象稳定性。
A Theory of Stabilization by Skull Carving
- 基于神经符号距离场和可微网格化,直接在非结构化网格上计算头骨刚性变换。
- 在包含多种面部动作的复杂表达数据集上,稳定度优于现有方法。
- 适合需自动处理不同体型人群的虚拟角色、VR及训练数据构建场景。
面部运动的精确稳定对3D游戏、虚拟现实、电影制作及训练数据采集中的逼真虚拟形象构建至关重要。尤其在泛人群应用中,系统需自动适应不同体型。区分头骨刚性运动与面部表情是关键,否则会导致动画模型难以控制且无法拟合自然运动。现有方法在稀疏、差异大的表情组合(如多单位面部动作编码系统FACS)下表现不佳,部分方法缺乏鲁棒性,依赖运动数据寻找稳定点,或做出不合理的生理假设。本文利用神经符号距离场与可微等值面网格化技术,直接在非结构化三角网格或点云上计算头骨刚性变换,显著提升精度与鲁棒性。提出‘稳定壳’概念——即经过稳定扫描的布尔交集表面,类似视觉壳与空间雕刻中的照片壳,其形态近似于仅覆盖薄软组织的颅骨,上牙自动包含其中。所提颅骨雕刻算法同时优化稳定壳形状与刚性变换,实现对大规模多样化人群复杂表情的高精度稳定,性能超越现有方法。
原文摘要 · Abstract (English)
Accurate stabilization of facial motion is essential for applications in photoreal avatar construction for 3D games, virtual reality, movies, and training data collection. For the latter, stabilization must work automatically for the general population with people of varying morphology. Distinguishing rigid skull motion from facial expressions is critical since misalignment between skull motion and facial expressions can lead to animation models that are hard to control and can not fit natural motion. Existing methods struggle to work with sparse sets of very different expressions, such as when combining multiple units from the Facial Action Coding System (FACS). Certain approaches are not robust enough, some depend on motion data to find stable points, while others make one-for-all invalid physiological assumptions. In this paper, we leverage recent advances in neural signed distance fields and differentiable isosurface meshing to compute skull stabilization rigid transforms directly on unstructured triangle meshes or point clouds, significantly enhancing accuracy and robustness. We introduce the concept of a stable hull as the surface of the boolean intersection of stabilized scans, analogous to the visual hull in shape-from-silhouette and the photo hull from space carving. This hull resembles a skull overlaid with minimal soft tissue thickness, upper teeth are automatically included. Our skull carving algorithm simultaneously optimizes the stable hull shape and rigid transforms to get accurate stabilization of complex expressions for large diverse sets of people, outperforming existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。