用两个高保真3D头身合成新穿搭,保持身份一致且无穿模。
AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization

- 直接拼接两个高保真高斯头身,避免2D转3D的画质下降。
- 通过局部扩散修复颈部发丝衔接,全身体积修复还原衣物外观。
- 适合需要精准身材适配与高质量穿搭定制的虚拟形象用户。
现有3D虚拟形象换装方法面临两大挑战:将2D编辑升维至3D常导致服装或身份质量下降;分层建模身体与服装则易产生穿模。本文提出AvatarMix,一种组合式范式,直接从两个高保真高斯虚拟形象中拼接头部与身体。该方法天然保留服装质量并避免穿模,但带来连接处不自然及形变后外观失真的问题。为此,我们设计双层优化策略:SeamFix——局部扩散模块,精细化修复发丝与颈部衔接;可选的FullbodyFix——全身体积修正模块,用于恢复形变后衣物外观。二者均基于已具3D一致性的高斯渲染图像,有效减少多视角伪影。为保障用户身体身份,采用基于网格的高斯表示,实现鲁棒的网格重定向技术,精准重塑被服身体以匹配用户体型,并适应多样化的身体形态。大量实验表明,本方法在服装保真度与身份一致性上达到当前最优,为真实感3D穿搭个性化提供了新思路。
原文摘要 · Abstract (English)
Existing 3D avatar outfit transfer methods face distinct challenges: approaches that lift 2D edits to 3D often suffer from outfit or identity quality degradation, while those that separately model body and clothing layers are prone to intersection artifacts. We introduce AvatarMix, a compositional paradigm that bypasses these issues by directly composing the head and body from two high-fidelity Gaussian avatars. While this paradigm inherently preserves outfit quality and avoids intersections, it introduces challenges in creating a seamless join and maintaining appearance fidelity after body reshaping. To this end, we propose a two-tier refinement strategy: SeamFix, a localized diffusion module that refines hair and neck to ensure an artifact-free join, and an optional full-body refinement, FullbodyFix, that restores garment appearance when retargeting degrades the clothed body. Both operate on renders from an already 3D-consistent Gaussian avatar, which limits multi-view artifacts compared to 2D-to-3D lifting. To preserve the user's body identity, our mesh-based Gaussian representation enables the adaptation of a robust mesh retargeting technique, precisely reshaping the clothed body to the user's physique and robustly handling diverse body shapes. Extensive experiments demonstrate that our method achieves state-of-the-art results in outfit fidelity and identity preservation, providing a new perspective for realistic 3D outfit personalization. Project page: https://larsph.github.io/avatarmix/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。