arXiv:2605.15824cs.CV2026-05被引 4

实现服装实时切换的视频生成框架,支持交互式穿搭预览。

FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization

论文配图:FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization
图 1 · 摘自论文原文
  • 用单件服装数据+上下文学习训练教师模型,隐式保持动作连贯性。
  • 通过流式蒸馏与缓存重调度,实现30-180倍提速,生成达23.8帧/秒。
  • 无需重新训练即可交互更换多件服装,适合电商与内容创作场景。

以服装为单位的人像视频定制具有重要商业价值,但现有方法难以实现低延迟与交互式控制。本文提出FashionChameleon,一种基于自回归视频生成的实时交互式人衣定制框架,支持生成过程中动态切换服装。该框架包含三项关键技术:(i)在单参考-服装对上采用上下文学习训练教师模型,通过图像与视频间不匹配迫使模型隐式保留运动一致性;(ii)引入流式蒸馏与上下文教学,通过梯度加权分布匹配蒸馏提升外推一致性;(iii)提出免训练的键值缓存重调度策略,包含服装键值刷新、历史键值回溯与参考键值解耦,实现多服装切换下的运动连贯性。该方法支持交互式定制与长视频稳定生成,在单张GPU上达到23.8 FPS,比现有基线快30–180倍。

原文摘要 · Abstract (English)

Human-centric video customization, particularly at the garment level, has shown significant commercial value. However, existing approaches cannot support low-latency and interactive garment control, which is crucial for applications such as e-commerce and content creation. This paper studies how to achieve interactive multi-garment video customization while preserving motion coherence using only single-garment video data. We present FashionChameleon, a real-time and interactive framework for human-garment customization in autoregressive video generation, where users can interactively switch garment during generation. FashionChameleon consists of three key techniques: (i) Instead of training on multi-garment video data, we train a Teacher Model with In-Context Learning on a single reference-garment pair. By retaining the image-to-video training paradigm while enforcing a mismatch between the reference and garment image, the model is encouraged to implicitly preserve coherence during single-garment switching. (ii) To achieve consistency and efficiency during generation, we introduce Streaming Distillation with In-Context Learning, which fine-tunes the model with in-context teacher forcing and improves extrapolation consistency via gradient-reweighted distribution matching distillation. (iii) To extend the model for interactive multi-garment video customization, we propose Training-Free KV Cache Rescheduling, which includes garment KV refresh, historical KV withdraw, and reference KV disentangle to achieve garment switching while preserving motion coherence. Our FashionChameleon uniquely supports interactive customization and consistent long-video extrapolation, while achieving real-time generation at 23.8 FPS on a single GPU, 30-180$\times$ faster than existing baselines.

视频生成交互定制服装生成实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。