arXiv:2503.12052cs.CVcs.GR2025-03被引 2

一键生成可物理模拟的3D虚拟人与合身服装,适合影视游戏制作。

A Text-to-3D Framework for Joint Generation of CG-Ready Humans and Compatible Garments

  • 用大模型解析文本,生成可定制的人体与服装模板。
  • 通过几何保真变形生成贴合身体的服装,支持物理仿真。
  • 多视角扩散纹理保持细节一致,适合对称服装设计。

传统创建带合身服装的高细节3D虚拟人需专业技能和繁重流程。尽管生成式AI已实现文本到3D人体与服装合成,但现有方法缺乏面向CG制作、可直接集成到传统管线的完整方案。本文提出Tailor,一个端到端文本到3D框架,生成高保真、可定制、兼容物理模拟的CG-ready 3D虚拟人。该框架分三步:(1) 语义解析:利用大语言模型将文本描述转为参数化人体与语义匹配的服装模板;(2) 几何感知服装生成:提出拓扑保持形变与新型几何损失,实现受文本控制的身体贴合服装生成;(3) 一致性纹理合成:设计多视角扩散过程,保证视角一致性,保留照片级细节,并支持常见服装的对称纹理生成。定量与定性评估表明,Tailor在保真度、可用性和多样性上均优于当前最优方法。代码将开源供学术使用。项目页:https://human-tailor.github.io

原文摘要 · Abstract (English)

Creating detailed 3D human avatars with fitted garments traditionally requires specialized expertise and labor-intensive workflows. While recent advances in generative AI have enabled text-to-3D human and clothing synthesis, existing methods fall short in offering accessible, integrated pipelines for generating CG-ready 3D avatars with physically compatible outfits; here we use the term CG-ready for models following a technical aesthetic common in computer graphics (CG) and adopt standard CG polygonal meshes and strands representations (rather than neural representations like NeRF and 3DGS) that can be directly integrated into conventional CG pipelines and support downstream tasks such as physical simulation. To bridge this gap, we introduce Tailor, an integrated text-to-3D framework that generates high-fidelity, customizable 3D avatars dressed in simulation-ready garments. Tailor consists of three stages. (1) Seman tic Parsing: we employ a large language model to interpret textual descriptions and translate them into parameterized human avatars and semantically matched garment templates. (2) Geometry-Aware Garment Generation: we propose topology-preserving deformation with novel geometric losses to generate body-aligned garments under text control. (3) Consistent Texture Synthesis: we propose a novel multi-view diffusion process optimized for garment texturing, which enforces view consistency, preserves photorealistic details, and optionally supports symmetric texture generation common in garments. Through comprehensive quantitative and qualitative evaluations, we demonstrate that Tailor outperforms state-of-the-art methods in fidelity, usability, and diversity. Our code will be released for academic use. Project page: https://human-tailor.github.io

文本生成3D虚拟人服装生成CG制作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。