arXiv:2510.00316cs.LG2025-10

用符号化特征和相似样本检索,让大模型零训练完成无线调制识别。

Large Language Models Can Perform Automatic Modulation Classification via Discretized Self-supervised Candidate Retrieval

  • 将连续信号特征转为符号令牌,减少提示长度超50%
  • 7B模型在分布内/外准确率均超82%,优于监督基线
  • 无需训练,小模型凭0.5K提示词超越大模型,适合资源受限场景

识别无线调制方式对认知无线电至关重要,但传统监督模型在分布外时性能下降,且从头训练专用无线基础模型计算成本过高。大语言模型(LLM)可通过上下文学习实现免训练替代,但直接输入浮点信号统计量会引入数值噪声并耗尽令牌预算。本文提出DiSC-AMC框架,通过激进的特征离散化与自监督嵌入的最近邻检索,将自动调制分类(AMC)重构为LLM推理任务。将连续特征映射为粗粒度符号令牌,使抽象信号模式与LLM推理能力对齐,并将提示长度压缩超50%。同时,利用DINOv2视觉编码器检索k_NN个最相似标注样本,提供高度相关、查询特定的上下文,而非通用类别均值。在10类基准上,微调的7B参数LLM使用DiSC-AMC在-10至+10 dB范围内实现83.0%的分布内准确率,在-11至-15 dB下达到82.50%的分布外准确率,优于监督基线。全面消融实验表明,该方法具备高令牌效率:一个免训练的7B模型仅用0.5K令牌提示即达71%准确率,超过依赖2.9K令牌提示的200B参数基线。此外,基于相似性的样本检索优于朴素类别平均选择超20%。最后,发现该流程存在根本局限:在极端分布外噪声水平(-30 dB)下,底层自监督表示崩溃,检索质量下降,分类退化为随机猜测。

原文摘要 · Abstract (English)

Identifying wireless modulation schemes is essential for cognitive radio, but standard supervised models often degrade under distribution shift, and training domain-specific wireless foundation models from scratch is computationally prohibitive. Large Language Models (LLMs) offer a promising training-free alternative via in-context learning, yet feeding raw floating-point signal statistics into LLMs overwhelms models with numerical noise and exhausts token budgets. We introduce DiSC-AMC, a framework that reformulates Automatic Modulation Classification (AMC) as an LLM reasoning task by combining aggressive feature discretization with nearest-neighbor retrieval over self-supervised embeddings. By mapping continuous features to coarse symbolic tokens, DiSC-AMC aligns abstract signal patterns with LLM reasoning capabilities and reduces prompt length by over $50$\%. Simultaneously, utilizing a DINOv2 visual encoder to retrieve the $k_\text{NN}$ most similar labeled exemplars provides highly relevant, query-specific context rather than generic class averages. On a 10-class benchmark, a fine-tuned 7B-parameter LLM using DiSC-AMC achieves $83.0$\% in-distribution accuracy ($-10$\,to\,$+10$\,dB) and $82.50$\% out-of-distribution (OOD) accuracy ($-11$\,to\,$-15$\,dB), outperforming supervised baselines. Comprehensive ablations on vanilla LLMs demonstrate the token efficiency of DiSC-AMC. A training-free $7$B LLM achieves $71$\% accuracy using only $0.5$\,K-token prompt,surpassing a $200$B-parameter baseline that relies on a $2.9$K-token prompt. Furthermore, similarity-based exemplar retrieval outperforms naive class-average selection by over $20$\%. Finally, we identify a fundamental limitation of this pipeline. At extreme OOD noise levels ($-30$\,dB), the underlying self-supervised representations collapse, degrading retrieval quality and reducing classification to random chance.

大模型调制识别零样本特征离散化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。