arXiv:2503.07252cs.CVeess.IV2025-03被引 12

通过视觉感知动态调整视频传输,节省带宽并保留关键信息

Semantic Communications with Computer Vision Sensing for Edge Video Transmission

  • 根据画面是否变化自适应调整压缩率,减少冗余传输
  • 结合目标检测与语义分割实时分析场景,判断帧重要性
  • 轻量级设计适合边缘设备,兼顾效率与实用性

尽管视觉传感器在监控等边缘应用中广泛使用,视频数据传输仍消耗大量频谱资源。语义通信(SC)通过提取和压缩语义层面的信息,在显著降低传输数据量的同时保持信息的准确性和相关性。然而,传统SC方法因重复传输静态帧而效率低下,且缺乏感知能力导致频谱利用不足。为此,本文提出一种结合计算机视觉感知的语义通信框架(SCCVS)。该框架引入可自适应压缩比(CR)的语义通信模型(CRSC),根据帧是否动态自动调节压缩率,有效节约频谱资源;同时设计基于目标检测与语义分割的感知方案(OSMS),通过上下文分析智能感知场景变化,评估每帧重要性,并将结果作为压缩比提示反馈给CRSC模型。两者均为轻量级设计,适配资源受限的边缘传感器。实验验证表明,SCCVS框架在不损失关键语义信息的前提下,显著提升传输效率。

原文摘要 · Abstract (English)

Despite the widespread adoption of vision sensors in edge applications, such as surveillance, the transmission of video data consumes substantial spectrum resources. Semantic communication (SC) offers a solution by extracting and compressing information at the semantic level, preserving the accuracy and relevance of transmitted data while significantly reducing the volume of transmitted information. However, traditional SC methods face inefficiencies due to the repeated transmission of static frames in edge videos, exacerbated by the absence of sensing capabilities, which results in spectrum inefficiency. To address this challenge, we propose a SC with computer vision sensing (SCCVS) framework for edge video transmission. The framework first introduces a compression ratio (CR) adaptive SC (CRSC) model, capable of adjusting CR based on whether the frames are static or dynamic, effectively conserving spectrum resources. Additionally, we implement an object detection and semantic segmentation models-enabled sensing (OSMS) scheme, which intelligently senses the changes in the scene and assesses the significance of each frame through in-context analysis. Hence, The OSMS scheme provides CR prompts to the CRSC model based on real-time sensing results. Moreover, both CRSC and OSMS are designed as lightweight models, ensuring compatibility with resource-constrained sensors commonly used in practical edge applications. Experimental simulations validate the effectiveness of the proposed SCCVS framework, demonstrating its ability to enhance transmission efficiency without sacrificing critical semantic information.

语义通信边缘计算视觉感知视频传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。