分离训练生成效率与长时鲁棒性,实现高质量实时无限虚拟人
Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatars

- 分两路并行训练:一路高效生成,一路增强长序列稳定性
- 单卡实现实时27.2帧768x512高清视频生成,支持无限时长交互
- 引入分块特征缓存机制,显著减少流式推理冗余计算
现有流式视频系统多采用串行蒸馏训练流程,以实现少步长长视频生成。但该范式存在两大局限:一是前期失败或分布偏移影响后续优化,导致训练难收敛;二是蒸馏目标偏向短期生成,长期自回归误差累积易引发质量下降。本文提出Avatar-Forever,一种用于高质量实时无限交互虚拟人的解耦并行训练框架。不将生成效率与长时鲁棒性耦合于串行蒸馏流程中,而是将其视为可并行训练的独立能力。一路执行全参数蒸馏,训练高视觉质量的高效生成器;另一路通过面向恢复的滚动训练(RRT)训练轻量级长时适配器,提升长序列推理下的生成鲁棒性。解耦设计简化训练过程,避免短时生成与长时适应间的客观冲突。进一步提出ForeverCache,一种分块特征缓存机制,大幅降低流式推理中的冗余历史计算。基于22B视频基础模型,Avatar-Forever支持无界音频驱动的虚拟人生成,保持身份一致性、动作连贯性与视觉保真度,单张H100 GPU实现768x512分辨率视频27.2 FPS端到端吞吐,为稳定数字人提供可行路径。
原文摘要 · Abstract (English)
Existing streaming video systems often rely on sequential, distillation-centered training pipelines to enable few-step long-video generation. However, this paradigm suffers from two limitations. First, failures or distribution shifts introduced in earlier stages affect later optimization, complicating the training process to converge. Second, the distillation-centric objective favours short-term generation but is prone to quality degradation when autoregressive errors accumulate over long rollouts. We propose Avatar-Forever, a decoupled parallel training framework for high-quality real-time infinite interactive avatars. Instead of coupling generation efficiency and long-horizon robustness under a sequential distillation pipeline, we treat them as two independent capabilities that can be trained in parallel. One branch performs full-parameter distillation to train an efficient generator with high visual quality, while another trains a lightweight long-horizon adapter via Recovery-oriented Rollout Training (RRT), which improves generation robustness under long-horizon inference conditions. Our decoupled parallel training design simplifies the overall training process and avoids unnecessary objective conflicts between few-step generation and long-horizon adaptation. We further introduce ForeverCache, a chunk-wise feature caching mechanism to substantially reduce redundant history computation during streaming inference. Built upon a 22B video foundation model, Avatar-Forever supports unbounded audio-driven avatar generation while maintaining identity consistency, motion coherence, and visual fidelity, enabling an end-to-end throughput of high-resolution 768x512 videos at 27.2 FPS on a single H100 GPU and providing a practical path toward stable digital humans.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。