用路径序列建模无线传播,让模型学会可复用的信号规律。
MultiPathFormer: Towards a Foundation Model for Multipath Wireless Propagation

- 将无线链路建模为路径序列,通过预测下一条路径预训练。
- 在未见环境中迁移性能超越从零训练,定位误差仅5.57米。
- 结合环境知识增强路径估计,适合做通信系统研发与算法设计者。
机器学习进展推动了无线基础模型的发展,旨在基于无线信号完成信道估计、波束预测和定位等任务。现有模型通常在信道张量上进行掩码重建预训练,但忽略了无线传播的物理特性。本文提出以多径传播为基础预训练对象,构建MultiPathFormer——一个自回归基础模型,将每个收发链路表示为连续路径令牌的有序序列,并采用下一步路径预测进行预训练。在此基础上引入环境RAG机制与首路径码本,利用环境知识提升时延与功率等路径统计估计,最高提升达59%。MultiPathFormer在27个环境上预训练后,可迁移到未见用户,在场景微调后表现优于从头训练模型。在下游任务中,其定位误差达5.57米,波束预测准确率0.914,视距分类准确率0.994,信道估计均方误差0.561,优于当前最先进信道基基础模型,证明路径级预训练能学习可复用的无线传播表征。
原文摘要 · Abstract (English)
Recent advances in machine learning have enabled training of wireless foundation models, which aim to support tasks such as channel estimation, beam prediction, and localization based on wireless signals. Existing wireless foundation models typically pretrain on channel tensors using masked reconstruction over subcarriers, antennas, or time but ignore the physical characteristics of wireless propagation. In this work, we propose to instead use multipath propagation as the fundamental pretraining object. We present MultiPathFormer, an autoregressive foundation model that represents each transmitter-receiver link as an ordered sequence of continuous-valued path tokens and pretrains with next-path prediction. We introduce an Environmental RAG (retrieval-augmented generation) mechanism and a first-path codebook on top of the transformer backbone, leveraging environment knowledge to improve path statistics estimation like delay and power by up to 59%. MultiPathFormer pretrained on 27 environments transfers to unseen users and, after scenario-specific fine-tuning, outperforms training the corresponding models from scratch in new environments. Across downstream tasks, it outperforms SOTA channel-based foundation models, achieving 5.57 m mean localization error, 0.914 top-3 beam accuracy, 0.994 line-of-sight classification accuracy, and 0.561 channel estimation NMSE. These results show that path-level pretraining can learn reusable representations of wireless propagation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。