提出点云分层分割新方法,实现衣物与身体多层重叠区域的精准识别。
Point cloud segmentation for 3D Clothed Human Layering
- 点云中每个点可同时属于多个层次,支持重叠衣物与身体的联合建模。
- 在合成与真实扫描数据上均验证了分层分割对衣物建模的显著提升效果。
- 适用于虚拟试衣、动画角色生成等需要精确衣物-身体关系的场景。
3D服装建模与仿真对于时尚、娱乐和动画等领域中的虚拟形象创建至关重要。由于着装人体形态变化大,尤其是褶皱生成困难,高质量建模极具挑战。3D扫描能提供更精确的真实物体表征,但缺乏语义信息,需依赖可靠的语义重建流程。此时,形状分割在识别语义部件中起关键作用。然而,现有3D形状分割方法主要面向场景理解,极少用于建模任务。在着装人体建模中,分割是实现完整语义部件重建(即底层身体与所穿衣物)的前置步骤。这些部件构成多层且高度重叠,与传统分割方法产生的互斥集合不同。本文提出一种新的3D点云分层分割范式,允许每个点同时关联多个层次。该方法可估计底层身体部位及被遮挡的衣物区域(即上层衣物遮挡下的下层衣物)。我们构建了一个模拟高保真3D扫描的合成数据集,包含各衣物层的真实标签。设计并评估了多种神经网络结构以应对3D衣物分层问题,涵盖粗粒度与细粒度的每层服装识别。实验表明,在合成与真实扫描数据集上,引入恰当的分层策略显著提升了服装域的分割性能。
原文摘要 · Abstract (English)
3D Cloth modeling and simulation is essential for avatars creation in several fields, such as fashion, entertainment, and animation. Achieving high-quality results is challenging due to the large variability of clothed body especially in the generation of realistic wrinkles. 3D scan acquisitions provide more accuracy in the representation of real-world objects but lack semantic information that can be inferred with a reliable semantic reconstruction pipeline. To this aim, shape segmentation plays a crucial role in identifying the semantic shape parts. However, current 3D shape segmentation methods are designed for scene understanding and interpretation and only few work is devoted to modeling. In the context of clothed body modeling the segmentation is a preliminary step for fully semantic shape parts reconstruction namely the underlying body and the involved garments. These parts represent several layers with strong overlap in contrast with standard segmentation methods that provide disjoint sets. In this work we propose a new 3D point cloud segmentation paradigm where each 3D point can be simultaneously associated to different layers. In this fashion we can estimate the underlying body parts and the unseen clothed regions, i.e., the part of a cloth occluded by the clothed-layer above. We name this segmentation paradigm clothed human layering. We create a new synthetic dataset that simulates very realistic 3D scans with the ground truth of the involved clothing layers. We propose and evaluate different neural network settings to deal with 3D clothing layering. We considered both coarse and fine grained per-layer garment identification. Our experiments demonstrates the benefit in introducing proper strategies for the segmentation on the garment domain on both the synthetic and real-world scan datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。