用人体模型先验实现高保真、无变形的文本驱动3D服装编辑。
T3HG-Editor: Text-driven 3D Human Garment Editing with Body Priors Embedded in SMPL-X

- 基于SMPL-X人体模型的几何与关节先验,分三阶段精准控制3D高斯点。
- 在多个视角间聚合同顶点特征,实现服装一致性,无需额外训练。
- 结合SDF距离场与语义掩码,有效防止高斯点溢出到非目标区域。
尽管3D高斯编辑(3DGE)进展迅速,但文本驱动的3D人体服装编辑仍研究不足。现有方法多将2D编辑应用于多视角渲染图并更新3D高斯,导致结果低保真且服装不一致。本文提出T3HG-Editor,利用嵌入在SMPL-X模型中的丰富人体先验信息,实现高保真、服装一致的编辑。该方法包含三个阶段:可编辑高斯点获取、服装一致性编辑、基于溢出剪枝的高斯更新。首先沿SMPL-X法向播种高斯点,并通过2D掩码精确定位待编辑区域;其次在多视角间聚合相同顶点的特征并回传,强制服装一致性,无需额外训练;最后利用定义在SMPL-X上的有符号距离函数(SDF)构建人体距离场,结合2D语义掩码剪除溢出高斯点,避免污染非目标区域。在多个受试者和多种服装类型上的实验表明,T3HG-Editor在编辑质量与服装一致性上均优于现有最先进方法。
原文摘要 · Abstract (English)
While 3D Gaussian Editing (3DGE) has seen substantial progress, text-driven 3D human garment editing remains largely underexplored. Existing 3DGE works typically follow a paradigm that applies 2D editing techniques to multi-view rendered images and updates 3D Gaussians based on the modified images. Extending such methods to 3D human garment editing suffers from low-fidelity outcomes, caused by introduced distortions and garment inconsistencies. A promising breakthrough opportunity arises from the SMPL eXpressive (SMPL-X) model that embodies rich prior information for virtual humans. Motivated by this insight, we propose a text-driven 3D human garment editor termed T3HG-Editor, which delivers high-fidelity and garment consistent results by leveraging geometry and joint priors embedded in SMPL-X. Specifically, T3HG-Editor contains three stages, namely obtainment of editable Gaussians, garment consistent editing, and Gaussian updating with overflow pruning. The obtainment of editable Gaussians begins with seeding Gaussians along SMPL-X normals to generate sufficient near surface Gaussians, followed by a 2D mask constraint that precisely localizes the target Gaussians to be edited. The garment consistent editing aggregates tokens corresponding to the same SMPL-X vertex across multiple views and propagates them to their original views, enforcing garment consistency without requiring additional training. Gaussian updating with overflow pruning employs a Signed Distance Function (SDF) defined on SMPL-X to construct a human distance field, which is then integrated with a 2D semantic mask to prune overflowing Gaussians, thus preventing contamination of non-target regions. Experiments on multiple subjects and diverse garment types demonstrate that T3HG-Editor outperforms state-of-the-art methods in both editing quality and garment consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。