让无线基础模型适应不同任务,只需极少量参数即可提升性能。
Lightweight Adaptive Feature Composition for Heterogeneous Downstream Adaptation of Wireless Foundation Models

- 通过动态路由选择多层特征,生成任务自适应的组合表示。
- 在4类任务中平均提升2.9%至35.9%,仅增加0.003M~0.049M可训练参数。
- 适合资源受限的移动系统,尤其在干扰环境下表现更稳健。
移动系统越来越多依赖异构学习型无线功能,而为每个任务单独训练模型会带来冗余的训练与管理开销。无线基础模型(WFMs)可使这些功能共享预训练主干网络,但现有适配方法要么为每项任务更新主干,要么依赖固定末层表示。我们观察到,中间层特征呈现深度相关的相关性结构。基于此,提出路由适配器特征组合(RAFC),将选定隐藏状态压缩为紧凑描述符,生成任务与样本相关的路由权重,并在不更新预训练主干的前提下融合原始高分辨率特征。其优势在于让每项任务能自适应地获取多层互补表示,而非局限于末层。在四个任务类别和三个WFM主干上实验均取得提升,跨四类任务的平均相对增益为2.9%至35.9%,而RAFC仅增加0.003M–0.049M可训练参数。在便携式软件定义无线电测试平台上进一步验证了端到端接收机鲁棒性提升,尤其在部分频带同频干扰下表现更优。结果表明,RAFC是面向移动系统的轻量、模型无关且可解释的适应接口。
原文摘要 · Abstract (English)
Mobile systems increasingly rely on heterogeneous learning-enabled wireless functions, for which separate taskspecific models incur redundant training and model-management overhead. Wireless foundation models (WFMs) enable these functions to share a pretrained backbone, but existing adaptation either updates the backbone per task or relies on an inflexible final-layer representation. We observe that intermediate WFM layers exhibit distinct depth-dependent correlation structures. Based on this observation, we propose a Routing Adapter for Feature Composition (RAFC), which summarizes selected hidden states into compact descriptors, generates task- and sampledependent routing weights, and combines the original fullresolution features without updating the pretrained backbone. Its gains arise from giving each task adaptive access to complementary representations across multiple depths rather than restricting it to the final layer. Experiments across four task categories and three WFM backbones show improvements in every evaluated backbone-task pair, with mean relative gains across the four task categories ranging from 2.9% to 35.9%, while RAFC adds only 0.003M-0.049M trainable parameters across the evaluated backbones. Experiments on a portable softwaredefined radio testbed further demonstrate improved end-to-end receiver robustness, particularly under partial-band co-channel interference. These results establish RAFC as a lightweight, model-agnostic, and interpretable adaptation interface for WFMs in mobile systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。