arXiv:2608.15066eess.SPcs.MM2026-08

将多模态数据离线编码为可复用参数包,降低重复访问延迟。

ParaJSCC: A Parameterized Framework for Reusable Multimodal Joint Source-Channel Coding

论文配图:ParaJSCC: A Parameterized Framework for Reusable Multimodal Joint Source-Channel Coding
图 1 · 摘自论文原文
  • 离线将多模态数据转为紧凑参数包,边缘缓存供快速调用
  • 图像仅请求时延迟从17.18ms降至4.34ms,全模态请求降为11.21ms
  • 支持按需传输,适合带宽变化的沉浸式通信场景

视觉、音频和触觉等多模态信号在沉浸式通信系统与数字孪生中日益作为持久数字资产存在。此类内容常被具有不同模态和带宽需求的异构接收端反复访问。现有压缩与联合源信道编码(JSCC)方法通常采用按需编码范式,导致重复访问时计算冗余、效率低下。为此,我们提出ParaJSCC,一种面向可复用表示服务的多模态JSCC框架。该框架在云端/内容服务器离线将每个多模态样本转换为紧凑、量化后的参数包,并存储于边缘服务节点以实现低延迟访问。服务阶段仅传输当前请求所需的子集,接收端进行轻量解码。框架采用渐进式共享-私有参数化,支持模态选择性传输与带宽变化下的可扩展重建。在多模态数据集上的实验表明,ParaJSCC显著降低在线延迟(如仅图像请求从17.18~ms降至4.34~ms,全模态请求从43.96~ms降至11.21~ms),传输速率减少47.8%~51.2%(针对选择性请求),同时在噪声信道下保持强重建质量。

原文摘要 · Abstract (English)

Multimodal signals, such as visual, audio, and tactile data, are increasingly maintained as persistent digital assets in immersive communication systems and digital twins. In these settings, the same multimodal content is repeatedly accessed by heterogeneous receivers with varying modality and bandwidth requirements. Existing compression and Joint Source-Channel Coding (JSCC) methods typically follow a per-request encoding paradigm, resulting in redundant computation and low efficiency during repeated access. To address this issue, we propose ParaJSCC, a multimodal JSCC framework designed for reusable representation serving. ParaJSCC converts each multimodal sample offline at the cloud/content server into a compact, quantized parameter package, which is then stored at the edge serving node for low-latency access. During serving, only the subset required by the current request is transmitted over the wireless channel, followed by lightweight decoding at the receiver. The framework employs a progressive shared-private parameterization to support modality-selective transmission and scalable reconstruction under varying bandwidth constraints. Experiments on multimodal datasets show that ParaJSCC significantly reduces online latency (e.g., from 17.18~ms to 4.34~ms for image-only requests and from 43.96~ms to 11.21~ms for full multimodal requests) and transmission rate (by 47.8\%--51.2\% for selective requests), while maintaining strong reconstruction quality under noisy channels.

多模态联合编码边缘计算低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。