用新方法生成更逼真的人体几何,支持服装细节与身体互动建模。
Generative Human Geometry Distribution
- 将几何分布编码为2D特征图,提升大规模学习效率
- 在SMPL人体模型上优化流速场,实现57%的几何质量提升
- 适合需要高保真人体生成的应用,如虚拟试衣、动画制作
真实人体几何生成是一项重要但具挑战性的任务,需同时保持精细服装细节并准确建模服装与身体的交互。现有基于流匹配模型的几何分布方法虽能高保真表示单个人体几何,但扩展至数据集时存在非平凡且低效的问题。为此,本文提出一种新几何分布模型,采用两项关键技术:(1) 将分布编码为2D特征图而非网络参数;(2) 以SMPL模型为域,替代传统高斯分布,并优化对应流速场。进一步设计了两阶段生成框架,类比当前主流图像与3D生成模型:第一阶段使用扩散流模型压缩几何分布至隐空间;第二阶段在该隐空间训练另一流模型。在姿态条件下的随机角色生成与角色一致的新姿态合成两个关键任务上验证方法有效性。实验表明,本方法优于现有最先进方法,在几何质量上提升57%。
原文摘要 · Abstract (English)
Realistic human geometry generation is an important yet challenging task, requiring both the preservation of fine clothing details and the accurate modeling of clothing-body interactions. To tackle this challenge, we build upon Geometry distributions, a recently proposed representation that can model a single human geometry with high fidelity using a flow matching model. However, extending a single-geometry distribution to a dataset is non-trivial and inefficient for large-scale learning. To address this, we propose a new geometry distribution model by two key techniques: (1) encoding distributions as 2D feature maps rather than network parameters, and (2) using SMPL models as the domain instead of Gaussian and refining the associated flow velocity field. We then design a generative framework adopting a two staged training paradigm analogous to state-of-the-art image and 3D generative models. In the first stage, we compress geometry distributions into a latent space using a diffusion flow model; the second stage trains another flow model on this latent space. We validate our approach on two key tasks: pose-conditioned random avatar generation and avatar-consistent novel pose synthesis. Experimental results demonstrate that our method outperforms existing state-of-the-art methods, achieving a 57% improvement in geometry quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。