让虚拟人穿松垮衣服动起来更真实,解决传统方法变形模糊的问题。
RealityAvatar: Towards Realistic Loose Clothing Modeling in Animatable 3D Gaussian Avatars
- 用3D高斯点云结合运动趋势模块,显式建模衣物随动作的动态变化
- 在基准数据集上显著提升非刚性区域的结构保真度和时序一致性
- 适合做高保真虚拟人、数字演员或动画角色的开发者使用
从单目或多视角视频构建可动画化的人体虚拟形象已得到广泛研究,近期方法利用神经辐射场(NeRF)或3D高斯点云(3DGS)在新视角和新姿态合成方面取得了显著成果。然而,现有方法通常难以准确捕捉松垮衣物的动力学特性,因其主要依赖全局姿态条件或每帧静态表示,导致非刚性区域出现过度平滑和时序不一致问题。为此,我们提出RealityAvatar,一种面向松垮服装的高效高保真数字人建模框架。该方法利用3D高斯点云捕捉复杂衣物形变与运动动态,同时保证几何一致性。通过引入运动趋势模块和潜骨编码器,显式建模姿态相关的形变及衣物行为的时间变化。在多个基准数据集上的大量实验表明,该方法能有效捕捉精细的衣物形变和运动驱动的形状变化,在动态人体重建中显著提升结构保真度和感知质量,尤其在非刚性区域表现优异,并实现更好的跨时间帧一致性。
原文摘要 · Abstract (English)
Modeling animatable human avatars from monocular or multi-view videos has been widely studied, with recent approaches leveraging neural radiance fields (NeRFs) or 3D Gaussian Splatting (3DGS) achieving impressive results in novel-view and novel-pose synthesis. However, existing methods often struggle to accurately capture the dynamics of loose clothing, as they primarily rely on global pose conditioning or static per-frame representations, leading to oversmoothing and temporal inconsistencies in non-rigid regions. To address this, We propose RealityAvatar, an efficient framework for high-fidelity digital human modeling, specifically targeting loosely dressed avatars. Our method leverages 3D Gaussian Splatting to capture complex clothing deformations and motion dynamics while ensuring geometric consistency. By incorporating a motion trend module and a latentbone encoder, we explicitly model pose-dependent deformations and temporal variations in clothing behavior. Extensive experiments on benchmark datasets demonstrate the effectiveness of our approach in capturing fine-grained clothing deformations and motion-driven shape variations. Our method significantly enhances structural fidelity and perceptual quality in dynamic human reconstruction, particularly in non-rigid regions, while achieving better consistency across temporal frames.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。