arXiv:2503.14736cs.CV2025-03中稿 · ECCV被引 1

提出结构坐标空间,让手部3D高斯点云更真实可动。

HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splatting

  • 用骨骼相对坐标表示每个高斯点,显式关联骨架结构。
  • 在复杂手势下仍能保持精细几何细节,结构一致性显著提升。
  • 适合做AR/VR、远程通信中的逼真手部动画建模。

逼真且可动画化的手部虚拟形象在AR/VR、游戏和远程通信中至关重要。基于3D高斯点云(3DGS)的头部建模方法虽已实现真人实时渲染,但手部建模仍面临挑战,因其结构紧凑、频繁自遮挡及手指交互复杂。现有方法多依赖姿态驱动变换,在欧氏空间中表示高斯点,缺乏与底层骨骼的显式结构关联,导致复杂动作下难以保持细粒度结构。本文提出结构坐标空间(SCS),一种以骨架为参考的表示方式,为每个高斯点分配相对于关节骨架的显式结构坐标。SCS结合静态-虚拟骨基底与距离-旋转结构描述符,编码高斯点与骨骼间的几何关系。基于SCS,通过每点残差嵌入与跨姿态结构对应,同时约束同姿态内与跨姿态间结构一致性。实验表明,相比现有3DGS方法,本方案在复杂手部动作下显著提升结构一致性并更好保留几何细节。

原文摘要 · Abstract (English)

Photorealistic and animatable hand avatars are essential for applications such as AR/VR, gaming, and telepresence. Recent 3D Gaussian Splatting (3DGS) based avatar methods enable real-time rendering of articulated humans, but modeling hands remains challenging due to their compact structure, frequent self-occlusions, and complex finger interactions. Existing approaches primarily rely on pose-driven transformations while representing Gaussians in Euclidean space, lacking an explicit structural association with the underlying skeleton, which makes preserving fine-grained hand structures under complex articulations difficult. In this work, we introduce the Structural Coordinate Space (SCS), a skeleton-relative representation that assigns each Gaussian primitive an explicit structural coordinate with respect to the articulated hand skeleton. SCS is constructed using a hybrid static-virtual bone basis together with a distance-rotation structural descriptor that encodes the geometric relationship between Gaussians and bones. Based on SCS, we enforce both intra-pose and cross-pose structural consistency by combining per-Gaussian residual embeddings for local appearance modeling with structural correspondence across poses. Experiments demonstrate that our approach significantly improves structural consistency and preserves fine geometric details under challenging hand articulations compared with existing 3DGS-based avatar methods.

手部建模3D高斯动画生成结构表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。