将野生自拍转为可控制的高保真人像,保留身份特征并简化姿态。
Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps
- 在统一的UV空间中解耦姿态与外观,实现无配对数据下的重定姿。
- 通过多图微调确保极端姿势下仍能准确保留个人身份特征。
- 适合虚拟试穿等下游任务,生成清晰高质的人体生物特征图
专业摄影师拍摄的人像通常具有优美光线、有趣姿势和修饰性效果,而普通人自拍则常在非受控环境下完成。本文旨在将此类‘野生’照片转换为可控、高保真的虚拟形象——置于简单环境中,穿着标准化基础衣物。核心挑战在于保留个体全身身份、面部特征与体态,同时去除原装衣物造成的复杂遮挡。由于缺乏同一人不同服装与姿态的成对数据,本文提出两大创新:1)将输入图像映射至统一的全身体积UV空间,并结合新颖的重定姿方法建模遮挡与合成新视角;该方法使姿态与外观解耦,可利用大规模无配对数据。2)通过多图像微调个性化输出,确保在极端姿态变化下仍能稳健保持身份一致性。实验表明,该方法在真实图像上取得优异定量表现,生成高质量重定姿人像,为虚拟试穿(VTO)等下游应用提供高保真生物特征基底。
原文摘要 · Abstract (English)
Photographs of people taken by professional photographers typically present the person in beautiful lighting, with an interesting pose, and flattering quality. This is unlike common photos people take of themselves in uncontrolled conditions. In this paper, we explore how to canonicalize a person's 'in-the-wild' photograph into a controllable, high-fidelity avatar -- reposed in a simple environment with standardized minimal clothing. A key challenge is preserving the person's unique whole-body identity, facial features, and body shape while stripping away the complex occlusions of their original garments. While a large paired dataset of the same person in varied clothing and poses would simplify this, such data does not exist. To that end, we propose two key insights: 1) Our method transforms the input photo into a canonical full-body UV space, which we couple with a novel reposing methodology to model occlusions and synthesize novel views. Operating in UV space allows us to decouple pose from appearance and leverage massive unpaired datasets. 2) We personalize the output photo via multi-image finetuning to ensure robust identity preservation under extreme pose changes. Our approach yields high-quality, reposed portraits that achieve strong quantitative performance on real-world imagery, providing an ideal, clean biometric canvas that significantly improves the fidelity of downstream applications like Virtual Try-On (VTO).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。