arXiv:2604.08548cs.CV2026-04被引 1

通过解耦去衣与密集匹配,实现穿衣服人体的鲁棒高精度拟合。

ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets

论文配图:ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets
图 1 · 摘自论文原文
  • 分阶段处理:先去除衣物干扰,再用密集对应关系拟合身体
  • 在4D-Dress等数据集上手部误差降低35.8%,未见数据提升超80%
  • 适合需要高精度人体建模的动画、虚拟试衣等应用

人体拟合将参数化人体模型(如SMPL)对齐到穿衣服人体的原始3D点云,是动画、贴图等下游任务的关键步骤。有效方法需兼具局部表达力(捕捉手部、面部细节)与全局鲁棒性(应对衣物动态、姿态变化、噪声或部分输入)。现有方法通常仅擅长其一。本文将ETCH升级为ETCH-X,采用紧致感知拟合策略过滤衣物影响(“去衣”),结合SMPL-X增强表达力,并以隐式密集对应替代敏感于部分数据的显式稀疏标记(“密集拟合”)。解耦的“去衣”与“密集拟合”模块支持可组合数据源的独立训练,涵盖多样模拟服装(CLOTH3D)、大规模全身动作(AMASS)及精细手势(InterHand2.6M),显著提升对不同服饰、姿态和输入完整性下的泛化能力。相比ETCH,在已见数据如4D-Dress(MPJPE-All, 33.0%)和CAPE(V2V-Hands, 35.8%)上表现更优;在未见数据如BEDLAM2.0(MPJPE-All, 80.8%;V2V-All, 80.5%)上也有显著提升。代码与模型将公开于https://xiaobenli00.github.io/ETCH-X/。

原文摘要 · Abstract (English)

Human body fitting, which aligns parametric body models such as SMPL to raw 3D point clouds of clothed humans, serves as a crucial first step for downstream tasks like animation and texturing. An effective fitting method should be both locally expressive-capturing fine details such as hands and facial features-and globally robust to handle real-world challenges, including clothing dynamics, pose variations, and noisy or partial inputs. Existing approaches typically excel in only one aspect, lacking an all-in-one solution. We upgrade ETCH to ETCH-X, which leverages a tightness-aware fitting paradigm to filter out clothing dynamics ("undress"), extends expressiveness with SMPL-X, and replaces explicit sparse markers (which are highly sensitive to partial data) with implicit dense correspondences ("dense fit") for more robust and fine-grained body fitting. Our disentangled "undress" and "dense fit" modular stages enable separate and scalable training on composable data sources, including diverse simulated garments (CLOTH3D), large-scale full-body motions (AMASS), and fine-grained hand gestures (InterHand2.6M), improving outfit generalization and pose robustness of both bodies and hands. Our approach achieves robust and expressive fitting across diverse clothing, poses, and levels of input completeness, delivering a substantial performance improvement over ETCH on both: 1) seen data, such as 4D-Dress (MPJPE-All, 33.0% ) and CAPE (V2V-Hands, 35.8% ), and 2) unseen data, such as BEDLAM2.0 (MPJPE-All, 80.8% ; V2V-All, 80.5% ). Code and models will be released at https://xiaobenli00.github.io/ETCH-X/.

人体拟合3D重建服装建模深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。