基于光流的多用户多任务视频传输框架,提升画质与效率
Goal-Oriented Framework for Optical Flow-based Multi-User Multi-Task Video Transmission
- 用光流提取关键运动语义,实现高效视频压缩
- 重建质量提升13.47% SSIM,分类精度超VideoMAE仅需25%数据
- 强化学习优化带宽分配,传输时延降低25.97%
高效多用户多任务视频传输是当前无线通信系统的重要研究方向。为降低传输负担、节省通信资源,本文提出一种面向光流的多用户多任务视频传输目标导向语义通信框架(OF-GSC)。在发送端,设计包含运动提取器和基于光流的块级语义表示提取器的语义编码器,有效识别并选择重要语义内容;接收端采用基于Transformer的语义解码器,支持高质量视频重建与视频分类任务。为最小化通信时延,提出基于深度确定性策略梯度(DDPG)的多用户带宽分配算法。实验表明,对于视频重建任务,该框架相较DeepJSCC在结构相似性指数(SSIM)上提升13.47%;对于视频分类任务,在相同遮蔽率0.3下,仅需25%数据量即可达到略高于VideoMAE的Top-1准确率;在带宽分配优化方面,所提DDPG算法相比基线均分带宽方案,最大传输时延减少25.97%。
原文摘要 · Abstract (English)
Efficient multi-user multi-task video transmission is an important research topic within the realm of current wireless communication systems. To reduce the transmission burden and save communication resources, we propose a goal-oriented semantic communication framework for optical flow-based multi-user multi-task video transmission (OF-GSC). At the transmitter, we design a semantic encoder that consists of a motion extractor and a patch-level optical flow-based semantic representation extractor to effectively identify and select important semantic representations. At the receiver, we design a transformer-based semantic decoder for high-quality video reconstruction and video classification tasks. To minimize the communication time, we develop a deep deterministic policy gradient (DDPG)-based bandwidth allocation algorithm for multi-user transmission. For video reconstruction tasks, our OF-GSC framework achieves a significant improvement in the received video quality, as evidenced by a 13.47% increase in the structural similarity index measure (SSIM) score in comparison to DeepJSCC. For video classification tasks, OF-GSC achieves a Top-1 accuracy slightly surpassing the performance of VideoMAE with only 25% required data under the same mask ratio of 0.3. For bandwidth allocation optimization, our DDPG-based algorithm reduces the maximum transmission time by 25.97% compared with the baseline equal-bandwidth allocation scheme.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。