arXiv:2604.26508cs.LGcs.AI2026-04中稿 · publication in the…

提出渐进式语义通信框架,让边缘设备与云端协作高效运行视觉语言模型。

Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Models

论文配图:Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Models
图 1 · 摘自论文原文
  • 用元自编码器将视觉特征转为可逐步细化的自适应表示
  • 1Mbps网络下比全边或全云方案更低延迟,压缩后仍保持高语义一致性
  • 无需微调即可对接现有视觉语言模型,适合带宽受限场景

在资源受限的嵌入式平台部署视觉语言模型(VLMs)面临巨大挑战,因其计算与内存需求远超边缘设备承载能力。而将推理完全上云在带宽受限环境中又不现实,因传输原始视觉数据会引入显著延迟。现有边缘-云协同架构通常依赖固定尺寸表示传输,缺乏对动态网络条件的适应性,且未能充分利用语义冗余。本文提出一种用于边缘-云视觉语言模型推理的渐进式语义通信框架,采用元自编码器将视觉标记压缩为可逐步细化的自适应表示,支持即插即用,无需额外微调即可与现成的VLMs集成。该设计允许在不同信息层级灵活传输,实现通信开销与语义保真度之间的可控权衡。我们在基于NXP i.MX95的嵌入式平台与GPU服务器间构建了端到端系统,在带宽受限网络下进行测试。实验表明,在1 Mbps上行带宽下,所提渐进式方案相比全边缘和全云端方案显著降低网络延迟,同时在高压缩率下仍保持高语义一致性。代码将在发表后公开于https://github.com/open-ep/ProSemComVLM。

原文摘要 · Abstract (English)

Deploying Vision-Language Models (VLMs) on edge devices remains challenging due to their substantial computational and memory demands, which exceed the capabilities of resource-constrained embedded platforms. Conversely, fully offloading inference to the cloud is often impractical in bandwidth-limited environments, where transmitting raw visual data introduces substantial latency overhead. While recent edge-cloud collaborative architectures attempt to partition VLM workloads across devices, they typically rely on transmitting fixed-size representations, lacking adaptability to dynamic network conditions and failing to fully exploit semantic redundancy. In this paper, we propose a progressive semantic communication framework for edge-cloud VLM inference, using a Meta AutoEncoder that compresses visual tokens into adaptive, progressively refinable representations, enabling plug-and-play deployment with off-the-shelf VLMs without additional fine-tuning. This design allows flexible transmission at different information levels, providing a controllable trade-off between communication cost and semantic fidelity. We implement a full end-to-end edge-cloud system comprising an embedded NXP i.MX95 platform and a GPU server, communicating over bandwidth-constrained networks. Experimental results show that, at 1 Mbps uplink, the proposed progressive scheme significantly reduces network latency compared to full-edge and full-cloud solutions, while maintaining high semantic consistency even under high compression. The implementation code will be released upon publication at https://github.com/open-ep/ProSemComVLM.

边缘计算视觉语言模型通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。