提出可灵活变速率的触觉信号编码框架,省去多模型存储并提升网络适应性。
Flexible Deep Joint Source-Channel Coding: A Vibrotactile Example

- 通过分层增益与可切换残差模块实现速率自适应编码
- 在支持4种码率时存储开销降低61.1%,重建性能媲美固定码率模型
- 适合实时触觉通信、低延迟网络等动态带宽场景
多媒体系统中对实时触觉通信的需求日益增长,暴露了现有联合源信道编码(JSCC)技术的局限性。当前JSCC模型虽支持端到端优化,但通常仅限于固定编码速率,不同速率需独立模型实例,导致存储开销大且难以适应动态带宽变化。为此,我们提出柔性深度联合源信道编码(FD-JSCC)框架,用于触觉信号传输,支持无需模型切换的灵活速率传输。该框架集成具备分层增益适配模块(HGAM)和速率可切换残差模块(RSRM)的柔性编码器-解码器,能根据码率选择性保留关键触觉特征。此外,引入信道特征处理模块(CFPM),利用实时信噪比(SNR)信息增强抗噪声与信号退化能力。在IEEE 1918.1.1触觉数据集上训练后,FD-JSCC在支持4种速率时,存储需求减少61.1%,同时重建性能与固定速率基线模型(如DeepSC-S)相当,展现出下一代网络中可扩展、低延迟触觉通信的巨大潜力。
原文摘要 · Abstract (English)
The increasing demand for real-time tactile communication in multimedia systems has exposed the limitations of existing Joint Source-Channel Coding (JSCC) techniques. While current JSCC models facilitate end-to-end optimization, they typically operate at fixed coding rates and require separate model instances for different rate settings. This results in significant storage overhead and limited adaptability to dynamic bandwidth conditions. To address these challenges, we propose the Flexible Deep Joint Source-Channel Coding (FD-JSCC) framework for vibrotactile signals, which supports flexible-rate transmission without the need for model switching. The FD-JSCC integrates a flexible-rate encoder-decoder enhanced with Hierarchical Gain Adaptation Module (HGAM) and Rate-Switchable Residual Module (RSRM), enabling bitrate-aware compression by selectively preserving salient vibrotactile features. Additionally, we introduce a Channel Feature Processing Module (CFPM), which leverages real-time SNR information to enhance robustness against channel noise and signal degradation. Trained on the IEEE 1918.1.1 vibrotactile dataset, FD-JSCC achieves reconstruction performance comparable to fixed-rate baselines (e.g., DeepSC-S), while reducing storage requirements by 61.1\% when supporting four rates. These results underscore its potential for scalable, low-latency tactile communication in next-generation networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。