用分区域生成法精准建模长裙等松散衣物,提升虚拟人动画真实感。
FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling
- 按距离身体远近分三区:裸露、变形、生成,分别处理
- 在基准数据集上达到顶尖效果,长裙等难建模衣物更逼真
- 适合做高精度虚拟人或影视角色动画的开发者
实现逼真动画虚拟人需准确建模姿态依赖的服装形变。现有学习方法严重依赖SMPL等基础人体模型的线性混合皮肤(LBS)来建模形变,但在处理长裙等松散衣物时,由于归一化过程在衣物远离身体时失效,导致结果断裂破碎。为此,我们提出FreeCloth,一种新型混合框架来建模复杂着装人体。核心思想是根据区域与身体的距离采用不同策略:将人体分为未着装、形变和生成三类。未着装区域直接复制,形变区域使用LBS处理;对于松散衣物区域(生成区),引入一种新颖的自由形式、部件感知生成器,因其受动作影响小。该自由生成范式增强了框架的灵活性与表现力,能捕捉长裙、礼服等复杂几何细节。在包含松散衣物的基准数据集上实验表明,FreeCloth在最挑战情况下也实现了当前最优视觉保真度与真实感。
原文摘要 · Abstract (English)
Achieving realistic animated human avatars requires accurate modeling of pose-dependent clothing deformations. Existing learning-based methods heavily rely on the Linear Blend Skinning (LBS) of minimally-clothed human models like SMPL to model deformation. However, they struggle to handle loose clothing, such as long dresses, where the canonicalization process becomes ill-defined when the clothing is far from the body, leading to disjointed and fragmented results. To overcome this limitation, we propose FreeCloth, a novel hybrid framework to model challenging clothed humans. Our core idea is to use dedicated strategies to model different regions, depending on whether they are close to or distant from the body. Specifically, we segment the human body into three categories: unclothed, deformed, and generated. We simply replicate unclothed regions that require no deformation. For deformed regions close to the body, we leverage LBS to handle the deformation. As for the generated regions, which correspond to loose clothing areas, we introduce a novel free-form, part-aware generator to model them, as they are less affected by movements. This free-form generation paradigm brings enhanced flexibility and expressiveness to our hybrid framework, enabling it to capture the intricate geometric details of challenging loose clothing, such as skirts and dresses. Experimental results on the benchmark dataset featuring loose clothing demonstrate that FreeCloth achieves state-of-the-art performance with superior visual fidelity and realism, particularly in the most challenging cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。