arXiv:2506.21093cs.LGcs.IT2025-06

用思维链让浅层Transformer高效识别无线符号

Chain-of-Thought Enhanced Shallow Transformers for Wireless Symbol Detection

  • 在浅层Transformer中引入自回归隐空间推理步骤
  • 1-2层模型性能接近深层模型,误码率显著降低
  • 适合资源受限的移动端无线接收设备

Transformer在无线通信问题中展现出潜力,尤其通过上下文学习(ICL)实现无需更新模型即可适应新任务。然而,现有基于ICL的Transformer依赖深层结构以达到良好性能,带来巨大存储与计算开销。本文提出链式思维符号检测框架CHOOSE,通过在隐藏空间引入自回归潜在推理步骤,显著提升浅层模型(1-2层)的推理能力,无需增加网络深度。该设计使轻量级Transformer达到与深层模型相当的检测性能,适用于资源受限的移动设备部署。实验表明,本方法优于传统浅层Transformer,性能接近深层模型,同时保持高存储与计算效率,为无线接收端部署Transformer算法提供了可行路径。

原文摘要 · Abstract (English)

Transformers have shown potential in solving wireless communication problems, particularly via in-context learning (ICL), where models adapt to new tasks through prompts without requiring model updates. However, prior ICL-based Transformer models rely on deep architectures with many layers to achieve satisfactory performance, resulting in substantial storage and computational costs. In this work, we propose CHain Of thOught Symbol dEtection (CHOOSE), a CoT-enhanced shallow Transformer framework for wireless symbol detection. By introducing autoregressive latent reasoning steps within the hidden space, CHOOSE significantly improves the reasoning capacity of shallow models (1-2 layers) without increasing model depth. This design enables lightweight Transformers to achieve detection performance comparable to much deeper models, making them well-suited for deployment on resource-constrained mobile devices. Experimental results demonstrate that our approach outperforms conventional shallow Transformers and achieves performance comparable to that of deep Transformers, while maintaining storage and computational efficiency. This represents a promising direction for implementing Transformer-based algorithms in wireless receivers with limited computational resources.

Transformer无线通信轻量化思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。