arXiv:2509.25749cs.CVcs.AI2025-09

解决虚拟试衣的边界伪影问题,生成更自然的人像穿搭图。

ART-VITON: Measurement-Guided Latent Diffusion for Artifact-Free Virtual Try-On

  • 将试衣建模为线性逆问题,用轨迹对齐求解器逐步增强测量一致性
  • 在三个数据集上显著提升视觉保真度,边界伪影几乎消失
  • 适合需要高保真人像穿搭生成的研究与工业应用

虚拟试衣(VITON)旨在生成人物穿戴目标服饰的逼真图像,要求试穿区域的服装对齐精确,非试穿区域的身份和背景忠实保留。尽管潜空间扩散模型(LDMs)提升了对齐与细节合成能力,但非试穿区域的保持仍具挑战。常见后处理策略直接替换该区域内容,但常引发边界伪影。为此,我们把VITON重新建模为线性逆问题,采用轨迹对齐求解器逐步强制测量一致性,减少非试穿区域的突变。然而,现有求解器在生成过程中仍存在语义漂移,导致伪影。我们提出ART-VITON,一种测量引导的扩散框架,在保证测量一致性的前提下实现无伪影合成。方法融合基于残差先验的初始化以缓解训练-推理不匹配,并引入无伪影测量引导采样,结合数据一致性、频域校正与周期性标准去噪。在VITON-HD、DressCode和SHHQ-1.0上的实验表明,ART-VITON能有效保持身份与背景,消除边界伪影,持续优于当前最优基线,在视觉保真度与鲁棒性上均有提升。

原文摘要 · Abstract (English)

Virtual try-on (VITON) aims to generate realistic images of a person wearing a target garment, requiring precise garment alignment in try-on regions and faithful preservation of identity and background in non-try-on regions. While latent diffusion models (LDMs) have advanced alignment and detail synthesis, preserving non-try-on regions remains challenging. A common post-hoc strategy directly replaces these regions with original content, but abrupt transitions often produce boundary artifacts. To overcome this, we reformulate VITON as a linear inverse problem and adopt trajectory-aligned solvers that progressively enforce measurement consistency, reducing abrupt changes in non-try-on regions. However, existing solvers still suffer from semantic drift during generation, leading to artifacts. We propose ART-VITON, a measurement-guided diffusion framework that ensures measurement adherence while maintaining artifact-free synthesis. Our method integrates residual prior-based initialization to mitigate training-inference mismatch and artifact-free measurement-guided sampling that combines data consistency, frequency-level correction, and periodic standard denoising. Experiments on VITON-HD, DressCode, and SHHQ-1.0 demonstrate that ART-VITON effectively preserves identity and background, eliminates boundary artifacts, and consistently improves visual fidelity and robustness over state-of-the-art baselines.

虚拟试衣扩散模型无伪影生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。