arXiv:2411.04249cs.CV2024-11被引 1

首个无需模板的松散衣物人体点云生成模型,支持姿态控制与编辑。

PocoLoco: A Point Cloud Diffusion Model of Human Shape in Loose Clothing

  • 基于去噪扩散框架,直接处理无序点云,无需参数化人体模型。
  • 在75K个松散衣物点云上训练,实现自然衣物形变与姿态适配。
  • 适合虚拟人动画、点云补全与交互式编辑,推动数字人发展。

构建可随姿态自然变形的人体虚拟角色是当前研究热点。本文提出PocoLoco——首个无需模板、基于点云、受姿态条件控制的3D松散衣物人体生成模型。现有方法多依赖人体参数化模型来约束形变,因而难以建模拓扑差异大的松散衣物;少数尝试建模松散衣物的方法通常需标准化或UV参数化,并面临显式对应关系估计难题。本工作将服装形变建模为去噪扩散框架下的条件点云生成任务,直接在无序点云上操作,无需参数化模型或衣物模板。该设计支持点云补全与基于姿态的编辑等实用功能,适用于虚拟人动画。由于当前松散衣物人体数据集规模过小,无法支撑扩散模型训练,我们发布了包含2名受试者在多种姿态下穿着松散衣物的点云数据集,共计7.5万条。通过扩充数据并解决松散衣物建模挑战,我们旨在为数字人研究提供新基础。代码已开源:https://github.com/sidsunny/pocoloco。

原文摘要 · Abstract (English)

Modeling a human avatar that can plausibly deform to articulations is an active area of research. We present PocoLoco -- the first template-free, point-based, pose-conditioned generative model for 3D humans in loose clothing. We motivate our work by noting that most methods require a parametric model of the human body to ground pose-dependent deformations. Consequently, they are restricted to modeling clothing that is topologically similar to the naked body and do not extend well to loose clothing. The few methods that attempt to model loose clothing typically require either canonicalization or a UV-parameterization and need to address the challenging problem of explicitly estimating correspondences for the deforming clothes. In this work, we formulate avatar clothing deformation as a conditional point-cloud generation task within the denoising diffusion framework. Crucially, our framework operates directly on unordered point clouds, eliminating the need for a parametric model or a clothing template. This also enables a variety of practical applications, such as point-cloud completion and pose-based editing -- important features for virtual human animation. As current datasets for human avatars in loose clothing are far too small for training diffusion models, we release a dataset of two subjects performing various poses in loose clothing with a total of 75K point clouds. By contributing towards tackling the challenging task of effectively modeling loose clothing and expanding the available data for training these models, we aim to set the stage for further innovation in digital humans. The source code is available at https://github.com/sidsunny/pocoloco .

点云生成人体建模扩散模型虚拟人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。