arXiv:2509.05030cs.CV2025-09被引 1

无需人工干预,自动将复杂衣物适配到任意角色上。

LUIVITON: Learned Universal Interoperable VIrtual Try-ON

  • 用SMPL作为中间代理,分两步建立衣物与人体的对应关系。
  • 支持非流形网格和多层衣物,生成物理合理的布料下垂效果。
  • 适用于人、机器人、卡通等多样化角色,适合游戏与虚拟试衣场景。

为实现真实3D资产的大规模复用,解决衣物与角色骨骼、模板或密集对应关系不一致的问题,我们提出一个全自动虚拟试衣系统,可将复杂多层衣物适配到各种姿态的人形角色上。核心思路是使用SMPL作为中间代理,将衣物到人体的迁移分解为两个不同挑战的对应任务:(1) 衣物到SMPL(部分到完整对齐),(2) 人体到SMPL(大姿态/体型变化与风格化)。我们采用几何驱动的对应模型解决前者,并引入基于扩散的体格到SMPL对应方法,结合多视角一致性外观特征与预训练2D基础模型。利用这些对应关系,我们将SMPL/SMPL+D(位移)注册至衣物与目标人体,通过模拟器驱动的拟合过程沿平滑的SMPL到SMPL+D过渡转移衣物,生成物理合理且自然的布料下垂效果。系统可处理复杂衣物拓扑(包括非流形网格),并泛化至广泛的人形角色(如人类、机器人、卡通、生物等),同时保持计算效率。在布料适配后,系统还支持快速调整衣物尺寸。实验表明,即使没有2D服装缝制图,本系统也能实现高质量3D衣物适配,全程无需人工参与。

原文摘要 · Abstract (English)

To enable large-scale reuse of real-world 3D assets, where garments and characters rarely share skeletons, templates, or dense correspondences, we present a fully automated virtual try-on system that dresses complex, multi-layer garments onto diverse, arbitrarily posed humanoids. Our key idea is to use SMPL as an intermediate proxy and decompose clothing-to-body transfer into two correspondence tasks with distinct challenges: (1) clothing-to-SMPL (partial-to-complete alignment) and (2) body-to-SMPL (large pose/shape variation and stylization). We address clothing-to-SMPL using a geometry-driven correspondence model, and introduce a diffusion-based body-to-SMPL correspondence approach that leverages multi-view consistent appearance features together with a pretrained 2D foundation model. Using these correspondences, we register SMPL/SMPL+D (Displacement) to the garment and target body and then perform simulator-driven fitting by transferring the garment along a smooth SMPL-to-SMPL+D transition, producing physically plausible draping on the target. Our system handles complex garment topology (including non-manifold meshes) and generalizes to a wide range of humanoid characters (e.g., humans, robots, cartoons, and creatures) while remaining computationally practical. Upon draping, our system also supports fast customization of clothing size. We show that our system can produce high-quality 3D clothing fittings without any human labor, even when 2D clothing sewing patterns are not available. Our project page is: https://cao-cong0.github.io/LUIVITON-Learned-Universal-Interoperable-VIrtual-Try-ON/.

虚拟试衣3D生成通用适配扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。