用轻量模型实现图像无线传输的自适应编码,性能强且开销小。
MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model
- 基于广义状态空间模型设计可逆扫描机制,捕捉全局信息。
- 通过注入信道状态信息实现无额外开销的自适应传输。
- 相比现有方法显著降低参数量与推理延迟,适合资源受限场景。
轻量高效的神经网络模型对语义通信中的深度联合源信道编码(JSCC)至关重要。本文提出一种新型JSCC架构MambaJSCC,采用视觉状态空间模型带信道自适应(VSSM-CA)模块作为主干,用于在无线信道上传输图像。VSSM-CA由广义状态空间模型(GSSM)与零参数、零计算的信道自适应方法(CSI-ReST)构成。我们设计了GSSM模块,利用可逆矩阵变换实现广义扫描扩展操作,并理论证明两个GSSM模块可有效捕获全局信息。发现GSSM具备天然信道适应能力,即内生智能。基于此,提出CSI-ReST方法:将信道状态信息(CSI)注入GSSM初始状态以利用其固有响应,并注入残差状态以缓解信道遗忘问题,从而实现高效信道自适应,且不增加计算与参数开销。实验表明,MambaJSCC在多种场景下均优于现有方法(如SwinJSCC),同时显著减少参数规模、计算开销和推理延迟。
原文摘要 · Abstract (English)
Lightweight and efficient neural network models for deep joint source-channel coding (JSCC) are crucial for semantic communications. In this paper, we propose a novel JSCC architecture, named MambaJSCC, that achieves state-of-the-art performance with low computational and parameter overhead. MambaJSCC utilizes the visual state space model with channel adaptation (VSSM-CA) blocks as its backbone for transmitting images over wireless channels, where the VSSM-CA primarily consists of the generalized state space models (GSSM) and the zero-parameter, zero-computational channel adaptation method (CSI-ReST). We design the GSSM module, leveraging reversible matrix transformations to express generalized scan expanding operations, and theoretically prove that two GSSM modules can effectively capture global information. We discover that GSSM inherently possesses the ability to adapt to channels, a form of endogenous intelligence. Based on this, we design the CSI-ReST method, which injects channel state information (CSI) into the initial state of GSSM to utilize its native response, and into the residual state to mitigate CSI forgetting, enabling effective channel adaptation without introducing additional computational and parameter overhead. Experimental results show that MambaJSCC not only outperforms existing JSCC methods (e.g., SwinJSCC) across various scenarios but also significantly reduces parameter size, computational overhead, and inference delay.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。