用2D高斯表面点实现可驱动的高保真头部建模,支持极端姿态下的精确形变。
SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatars
- 基于2D高斯表面点与仿射变换融合,实现几何形变
- 在极端姿态下仍保持法向与图像高保真渲染
- 结合传统网格变形技术,适合虚拟人与数字孪生应用
近期基于高斯原语的头部动画渲染取得了显著高保真效果。然而,现有方法依赖相似性变换,难以捕捉复杂几何细节和未见姿态下的形变,因无法处理拉伸与剪切。为此,我们提出SurFhead,一种从RGB视频重建可驱动头部几何的方法,利用具有明确定义几何属性的2D高斯表面点(surfel),包括固定射线交点的精确深度和由表面朝向导出的法向,优于3D对应物。SurFhead通过经典网格变形传递与仿射变换插值,确保在极端姿态下仍能高保真渲染法向与图像。其核心在于引入变换的极分解来精确处理形变并融合表面点,包括法向影响。本工作首次将传统图形学中的网格变形技术与现代高斯原语结合,实现了最先进的几何重建与渲染质量。相比以往方法,SurFhead在高效重建的同时保持高保真几何,适用于虚拟人、数字孪生等场景。
原文摘要 · Abstract (English)
Recent advancements in head avatar rendering using Gaussian primitives have achieved significantly high-fidelity results. Although precise head geometry is crucial for applications like mesh reconstruction and relighting, current methods struggle to capture intricate geometric details and render unseen poses due to their reliance on similarity transformations, which cannot handle stretch and shear transforms essential for detailed deformations of geometry. To address this, we propose SurFhead, a novel method that reconstructs riggable head geometry from RGB videos using 2D Gaussian surfels, which offer well-defined geometric properties, such as precise depth from fixed ray intersections and normals derived from their surface orientation, making them advantageous over 3D counterparts. SurFhead ensures high-fidelity rendering of both normals and images, even in extreme poses, by leveraging classical mesh-based deformation transfer and affine transformation interpolation. SurFhead introduces precise geometric deformation and blends surfels through polar decomposition of transformations, including those affecting normals. Our key contribution lies in bridging classical graphics techniques, such as mesh-based deformation, with modern Gaussian primitives, achieving state-of-the-art geometry reconstruction and rendering quality. Unlike previous avatar rendering approaches, SurFhead enables efficient reconstruction driven by Gaussian primitives while preserving high-fidelity geometry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。