arXiv:2607.17482cs.CV2026-07中稿 · on 8 July, and awa…被引 2

用生成模型重构视频传输,低带宽下仍保清晰可用

Generative Transmission: Rethinking Computation, Bandwidth, and Memory in Communication

论文配图:Generative Transmission: Rethinking Computation, Bandwidth, and Memory in Communication
图 1 · 摘自论文原文
  • 将传输视为带宽/计算/内存联合优化问题
  • 超低码率下仍保持视觉连贯与实用质量
  • 适合弱网络环境的智能视频通信系统

在AI Flow框架下,通信正从传递高保真信息转向任务导向和感知导向的令牌流传输。视频通信是现代信息网络的核心,但在超低带宽和弱网络条件下,传统以像素保真度优化的编码方法难以兼顾视觉可用性、传输效率和链路鲁棒性。随着生成模型快速发展,视频通信也从精确信号重建转向接收端感知效用与系统整体可用性。本文提出生成式传输(GenTrans),用于超低带宽和弱网络条件下的视频通信。基于生成视频压缩(GVC),GenTrans将视频传输建模为带宽、计算与内存的联合优化问题,而非单纯的信号编码任务。通过利用生成先验、跨片段内存复用、运行时状态复用及弱网络感知传输机制,显著降低传输开销,实现视觉连贯且实用的重建效果。实验表明,GenTrans在超低比特率和弱网络条件下仍能有效传输视频,提升传输效率、解码效率与鲁棒性,同时保持感知质量。

原文摘要 · Abstract (English)

Under the AI Flow framework, communication is shifting from transmitting fidelity-oriented information flows toward delivering task-oriented and perception-oriented token flows across heterogeneous network resources. Video communication is a fundamental component of modern information networks. However, under ultra-low-bandwidth and weak-network conditions, conventional video coding and transmission methods, which are primarily optimized for pixel-level fidelity, often struggle to balance visual usability, transmission efficiency, and robustness to unstable links. With the rapid advancement of generativemodels, video communication is also moving from precise signal reconstruction toward receiver-side perceptual utility and system-level usability. In this paper, we propose Generative Transmission (GenTrans) for video communication under ultra-low-bandwidth and weak-network conditions. Built upon Generative Video Compression (GVC), GenTrans formulates video transmission as a joint optimization problem involving bandwidth, computation, and memory, rather than treating it merely as a signal coding task. By leveraging generative priors, cross-clip memory reuse, runtime state reuse, and weak-network-aware transport, GenTrans significantly reduces transmission overhead while enabling visually coherent and practically useful reconstruction. Experimental results show that GenTrans supports effective video transmission under ultra-low-bitrate and weak-network conditions, achieving improved transmission efficiency, decoding efficiency, and robustness while preserving perceptual quality.

视频通信生成模型低带宽

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。