arXiv:2505.07381cs.CVcs.AI2025-05

用少量样本实现监控视频的语义压缩与重建,大幅降低传输存储负担。

Few-shot Semantic Encoding and Decoding for Video Surveillance

  • 提取草图作为语义信息,结合压缩技术降低码率。
  • 通过参考帧实现草图到视频帧的图像翻译,提升重建质量。
  • 少样本训练即可适配新场景,适合实际部署的监控系统。

随着监控摄像头数量和分辨率持续增加,视频传输与存储压力不断上升。传统基于香农理论的通信方式面临优化瓶颈。语义通信作为一种新兴方法,有望突破此瓶颈,降低视频存储与传输开销。现有语义解码方法通常需大量样本训练每个场景的神经网络,耗时且费力。本文提出一种面向监控视频的语义编码与解码方法:首先提取草图作为语义信息,并提出草图压缩方法以降低语义信息码率;其次设计图像翻译网络,将草图基于参考帧转换为视频帧;最后提出少样本草图解码网络,实现从草图重建视频。实验表明,所提方法在视频重建性能上显著优于基线方法。草图压缩方法有效降低语义信息存储与传输开销,对视频质量影响极小。该方法仅需少量训练样本即可适配新监控场景,显著提升语义通信系统的实用性。

原文摘要 · Abstract (English)

With the continuous increase in the number and resolution of video surveillance cameras, the burden of transmitting and storing surveillance video is growing. Traditional communication methods based on Shannon's theory are facing optimization bottlenecks. Semantic communication, as an emerging communication method, is expected to break through this bottleneck and reduce the storage and transmission consumption of video. Existing semantic decoding methods often require many samples to train the neural network for each scene, which is time-consuming and labor-intensive. In this study, a semantic encoding and decoding method for surveillance video is proposed. First, the sketch was extracted as semantic information, and a sketch compression method was proposed to reduce the bit rate of semantic information. Then, an image translation network was proposed to translate the sketch into a video frame with a reference frame. Finally, a few-shot sketch decoding network was proposed to reconstruct video from sketch. Experimental results showed that the proposed method achieved significantly better video reconstruction performance than baseline methods. The sketch compression method could effectively reduce the storage and transmission consumption of semantic information with little compromise on video quality. The proposed method provides a novel semantic encoding and decoding method that only needs a few training samples for each surveillance scene, thus improving the practicality of the semantic communication system.

语义通信少样本学习视频压缩监控系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。