让手机在低带宽下流畅播放高质量视频，速度提升13.6倍。
PromptMobile: Efficient Promptus for Low Bandwidth Mobile Video Streaming
- 分两阶段生成提示词，计算量降低8.1倍。
- 帧间精细缓存减少16.6%重复计算。
- 适合移动端实时视频流，画质显著优于传统方法。
传统视频压缩算法在极低码率下质量严重下降。Promptus作为新型视频流传输范式，大幅降低传输带宽需求，但其计算开销大，无法在移动设备上实时运行。本文提出PromptMobile，一种专为移动端优化的Promptus加速框架：(1) 提出两阶段高效生成机制，计算成本降低8.1倍；(2) 采用细粒度帧间缓存，减少16.6%冗余计算；(3) 实施系统级优化。评估表明，相比原版Promptus，PromptMobile图像生成速度提升13.6倍。相较于其他流媒体方法，其平均LPIPS改善0.016（对比H.265），严重失真帧减少60%（对比VQGAN）。
原文摘要 · Abstract (English)
Traditional video compression algorithms exhibit significant quality degradation at extremely low bitrates. Promptus emerges as a new paradigm for video streaming, substantially cutting down the bandwidth essential for video streaming. However, Promptus is computationally intensive and can not run in real-time on mobile devices. This paper presents PromptMobile, an efficient acceleration framework tailored for on-device Promptus. Specifically, we propose (1) a two-stage efficient generation framework to reduce computational cost by 8.1x, (2) a fine-grained inter-frame caching to reduce redundant computations by 16.6%, (3) system-level optimizations to further enhance efficiency. The evaluations demonstrate that compared with the original Promptus, PromptMobile achieves a 13.6x increase in image generation speed. Compared with other streaming methods, PromptMobile achives an average LPIPS improvement of 0.016 (compared with H.265), reducing 60% of severely distorted frames (compared to VQGAN).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。