手机端实现高清虚拟试衣,无需上传照片,隐私安全。
Mobile-VTON: High-Fidelity On-Device Virtual Try-On
- 模块化架构整合知识蒸馏与服装条件生成,适配移动端运行。
- 在VITON-HD和DressCode上达到云端模型水平,1024x768分辨率下表现优异。
- 适合注重隐私、需离线部署的电商试衣场景。
虚拟试衣(VTON)近年已实现高视觉保真度,但多数系统需将个人照片上传至云端GPU,引发隐私担忧并限制本地部署。为此,我们提出Mobile-VTON,一个高质量、隐私保护的框架,仅用一张用户图像和一张服饰图像即可在普通手机上实现完全离线虚拟试衣。该框架采用模块化教师网络-服饰网络-试衣网络(TGT)架构,集成知识蒸馏、服饰条件生成与服饰对齐,优化移动端效率。其中,特征引导对抗蒸馏(FGA)策略结合教师监督与对抗学习,更贴近真实图像分布;服饰网络通过轨迹一致性损失保持扩散过程中的服饰语义;试衣网络采用潜空间拼接与轻量跨模态条件控制,实现鲁棒的服饰到人体对齐,无需大规模预训练。实验表明,在VITON-HD和DressCode数据集上,1024×768分辨率下,Mobile-VTON性能媲美甚至超越强基准服务器模型,且全程离线运行。结果证明,高质量虚拟试衣在移动端不仅可行,且具备实际应用价值。代码与项目页见 https://zhenchenwan.github.io/Mobile-VTON/。
原文摘要 · Abstract (English)
Virtual try-on (VTON) has recently achieved impressive visual fidelity, but most existing systems require uploading personal photos to cloud-based GPUs, raising privacy concerns and limiting on-device deployment. To address this, we present Mobile-VTON, a high-quality, privacy-preserving framework that enables fully offline virtual try-on on commodity mobile devices using only a single user image and a garment image. Mobile-VTON introduces a modular TeacherNet-GarmentNet-TryonNet (TGT) architecture that integrates knowledge distillation, garment-conditioned generation, and garment alignment into a unified pipeline optimized for on-device efficiency. Within this framework, we propose a Feature-Guided Adversarial (FGA) Distillation strategy that combines teacher supervision with adversarial learning to better match real-world image distributions. GarmentNet is trained with a trajectory-consistency loss to preserve garment semantics across diffusion steps, while TryonNet uses latent concatenation and lightweight cross-modal conditioning to enable robust garment-to-person alignment without large-scale pretraining. By combining these components, Mobile-VTON achieves high-fidelity generation with low computational overhead. Experiments on VITON-HD and DressCode at 1024 x 768 show that it matches or outperforms strong server-based baselines while running entirely offline. These results demonstrate that high-quality VTON is not only feasible but also practical on-device, offering a secure solution for real-world applications. Code and project page are available at https://zhenchenwan.github.io/Mobile-VTON/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。