用上下文学习提升多天线图像传输的解码质量,尤其在硬件失真下表现更优。
In-Context Learning for Deep Joint Source-Channel Coding Over MIMO Channels
- 将Transformer的上下文学习融入深融合信源信道编码,利用导频信息协同优化收发策略。
- 在有无信道状态信息下均显著提升图像重建质量,尤其在正交失配时性能超越传统方法。
- 适合研究智能通信系统、端到端图像传输及硬件非理想场景下的模型设计者。
大型语言模型展现出上下文学习(ICL)能力,即通过直接映射查询与任务中的少量示例来完成预测。本文研究在多输入多输出(MIMO)系统中,基于深度联合信源信道编码(DeepJSCC)的图像传输场景下的ICL应用,采用ICL去噪器进行MIMO符号估计。首先,在无硬件失真的情况下,探索基于Transformer的ICL与DeepJSCC在开环和闭环MIMO系统中的集成,依据收发端是否具备信道状态信息(CSI)而分别设计架构。两种场景下均提出新型MIMO收发机结构,将导频序列及其输出作为额外上下文输入,使DeepJSCC编码器、解码器与ICL去噪器能联合学习针对每种信道实现的编码、解码与估计策略。进一步扩展至更具挑战性的场景:收发机存在同相/正交(IQ)失衡,导致非线性MIMO估计。此时仍利用上下文信息,促进在硬件失真与变化信道条件下,编码器、解码器与ICL去噪器的联合学习。数值结果表明,用于MIMO估计的ICL去噪器显著优于传统最小二乘法,尤其在IQ失衡下优势更明显。所提出的基于Transformer的ICL框架结合上下文信息,在收发端存在IQ失衡时,显著提升了端到端图像重建质量。
原文摘要 · Abstract (English)
Large language models have demonstrated the ability to perform \textit{in-context learning} (ICL), whereby the model performs predictions by directly mapping the query and a few examples from the given task to the output variable. In this paper, we study ICL for deep joint source-channel coding (DeepJSCC) in image transmission over multiple-input multiple-output (MIMO) systems, where an ICL denoiser is employed for MIMO symbol estimation. We first study the transceiver without any hardware impairments and explore the integration of transformer-based ICL with DeepJSCC in both open-loop and closed-loop MIMO systems, depending on the availability of channel state information (CSI) at the transceiver. For both open-loop and closed-loop scenarios, we propose two MIMO transceiver architectures that leverage context information, i.e., pilot sequences and their outputs, as additional inputs, enabling the DeepJSCC encoder, DeepJSCC decoder, and the ICL denoiser to jointly learn encoding, decoding, and estimation strategies tailored to each channel realization. Next, we extend our study to a more challenging scenario where the transceiver suffers from in-phase and quadrature (IQ) imbalance, resulting in nonlinear MIMO estimation. In this case, the context information is also exploited, facilitating joint learning across the DeepJSCC encoder, decoder, and the ICL denoiser under hardware impairments and varying channel conditions. Numerical results demonstrate that the ICL denoiser for MIMO estimation significantly outperforms the conventional least-squares method, with even greater advantages under IQ imbalance. Moreover, the proposed transformer-based ICL framework, integrated with contextual information, achieves significant improvements in end-to-end image reconstruction quality under transceiver IQ imbalance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。