arXiv:2604.12622cs.CVcs.AI2026-04被引 1

边端交通监控中,用语义信息替代图像,传输量减少99%以上。

Efficient Semantic Image Communication for Traffic Monitoring at the Edge

论文配图:Efficient Semantic Image Communication for Traffic Monitoring at the Edge
图 1 · 摘自论文原文
  • 用分割图、边缘图和文字描述代替像素,压缩率超99%
  • 接收端用生成模型还原场景,保持关键语义信息
  • 适合资源受限的边端设备,兼顾隐私与视觉可用性

许多视觉监控系统面临严格的通信限制,全分辨率图像传输不切实际且常无必要。此类场景中,视觉数据主要用于判断物体存在、空间关系和场景上下文,而非像素级保真度。本文提出两种面向交通监控的语义图像通信管道:MMSD(多模态语义分解)和SAMR(语义感知掩码重建),在降低传输成本的同时保留有意义的视觉信息。MMSD 通过紧凑的语义表示(分割图、边缘图、文本描述)替代原图,接收端利用基于扩散的生成模型重建场景,实现极高压缩与数据保密性。SAMR 在标准JPEG编码前根据语义重要性选择性抑制非关键区域,并在接收端通过生成修复恢复缺失内容。两者均采用异构发送-接收架构,边端执行轻量处理,计算密集型重建由服务器完成。在 Raspberry Pi 5 上,边端处理时间分别为约15秒(MMSD)和9秒(SAMR)。实验表明,平均传输数据量分别减少99%(MMSD)和99.1%(SAMR)。MMSD 的负载大小低于近期 SPIC 基线,同时保持强语义一致性;SAMR 在同等条件下相比标准JPEG和SQ-GAN提供更优的质量-压缩权衡。

原文摘要 · Abstract (English)

Many visual monitoring systems operate under strict communication constraints, where transmitting full-resolution images is impractical and often unnecessary. In such settings, visual data is often used for object presence, spatial relationships, and scene context rather than exact pixel fidelity. This paper presents two semantic image communication pipelines for traffic monitoring, MMSD and SAMR, that reduce transmission cost while preserving meaningful visual information. MMSD (Multi-Modal Semantic Decomposition) targets very high compression together with data confidentiality, since sensitive pixel content is not transmitted. It replaces the original image with compact semantic representations, namely segmentation maps, edge maps, and textual descriptions, and reconstructs the scene at the receiver using a diffusion-based generative model. SAMR (Semantic-Aware Masking Reconstruction) targets higher visual quality while maintaining strong compression. It selectively suppresses non-critical image regions according to semantic importance before standard JPEG encoding and restores the missing content at the receiver through generative inpainting. Both designs follow an asymmetric sender-receiver architecture, where lightweight processing is performed at the edge and computationally intensive reconstruction is offloaded to the server. On a Raspberry Pi~5, the edge-side processing time is about 15s for MMSD and 9s for SAMR. Experimental results show average transmitted-data reductions of 99% for MMSD and 99.1% for SAMR. In addition, MMSD achieves lower payload size than the recent SPIC baseline while preserving strong semantic consistency, whereas SAMR provides a better quality-compression trade-off than standard JPEG and SQ-GAN under comparable operating conditions.

语义通信边端计算图像压缩生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。