arXiv:2607.03803cs.CVcs.AI2026-07

CineMobile让手机端生成电影级运镜视频,40倍提速且模型小于1GB。

CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation

论文配图:CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation
图 1 · 摘自论文原文
  • 通过知识蒸馏剪枝压缩模型,保留电影运镜生成能力。
  • 将生成步数优化至4步,单步去噪延迟仅0.6秒。
  • 适合移动端部署,支持480p 49帧视频实时生成。

移动端对图像转视频创作的需求日益增长,尤其关注子弹时间、推拉镜头、慢动作等电影级运动效果。尽管扩散变换器(DiTs)在视频生成上表现优异,但其庞大的参数量和多步迭代去噪过程带来巨大计算开销,难以在移动设备高效运行。本文提出CineMobile,采用三重优化策略:(1)利用基于知识蒸馏的剪枝方法,构建轻量但高效的模型,保留生成电影级特效所需的核心能力;(2)结合扩散蒸馏与强化学习,将压缩模型优化为4步生成器;(3)采用混合后训练量化策略,使模型体积压缩至1GB以下。实验表明,相比使用Wan 2.1架构的教师模型,CineMobile实现40倍生成速度提升,同时保持相近视觉质量。具体而言,在NVIDIA H200 GPU上生成49帧480p视频,每步去噪延迟0.6秒;在联发科天玑8400至尊版5G平台耗时20秒,峰值内存占用1.8GB,验证了其在移动端图像转视频创作中的实际可行性。

原文摘要 · Abstract (English)

The growing demand for image-to-video creation on mobile devices has increasingly focused on cinematic motion effects like bullet time, dolly zoom, slow motion, etc. While Diffusion Transformers (DiTs) exhibit strong performance in video generation, their large parameter sizes and multi-step iterative denoising processes lead to substantial computational overhead, making efficient generation on mobile devices challenging. We propose CineMobile to bridge the gap. In particular, CineMobile adopts a three-fold optimization strategy: (1) leveraging a distillation-guided pruning approach to derive a compact yet efficient model that retains the essential video generation capabilities required for cinematic effects; (2) optimizing the compressed model into a 4-step generator via a combination of diffusion distillation and reinforcement learning; (3) employing a hybrid post-training quantization strategy to compress the model footprint to under 1 GB. Experimental results show that compared to the teacher model with the Wan 2.1 architecture, CineMobile achieves a 40x speedup in generation while maintaining comparable visual quality. Specifically, CineMobile generates 49-frame 480p videos with a per-step denoising latency of 0.6s on an NVIDIA H200 GPU and 20s on the MediaTek Dimensity 8400 Ultimate 5G platform, with a peak memory usage of 1.8 GB, demonstrating its practical applicability for mobile-based image-to-video creation.

图像转视频扩散模型移动端电影运镜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。