用轻量Transformer提升复杂无线环境下的室内定位精度。
Transforming Indoor Localization: Advanced Transformer Architecture for NLOS Dominated Wireless Environments with Distributed Sensors
- 提出传感器快照分词法,捕捉多变量相关性。
- 新模型比大模型快40%以上,用更少算力和数据达更高精度。
- 适合嵌入式设备部署,特别适用于信号遮挡严重的场景。
在复杂的非视距(NLOS)室内环境中,传统定位方法精度较差。尽管深度学习已被用于应对这些挑战,但许多方法忽视了计算复杂度,尤其在浮点运算量(FLOPs)方面,难以在资源受限设备上运行。基于Transformer的模型在自然语言处理和计算机视觉中表现优异,但在室内定位中应用仍不成熟,直接使用会带来高计算开销且精度有限。为此,本文提出一种新型分词方法——传感器快照分词(SST),保留功率时延轮廓(PDP)的变量特异性,并通过有效建模多变量相关性增强注意力机制。同时,设计了一种轻量级基于Swish-Gated Linear Unit的Transformer(L-SwiGLU-T),在不牺牲定位精度的前提下显著降低计算复杂度。实验结果表明,在模拟与真实数据集上,SST与L-SwiGLU-T相比更大规模的Transformer和CNN基线模型,定位精度提升超40%,同时所需FLOPs和训练样本数量大幅减少。
原文摘要 · Abstract (English)
Indoor localization in challenging non-line-of-sight (NLOS) environments often leads to poor accuracy with traditional approaches. Deep learning (DL) has been applied to tackle these challenges; however, many DL approaches overlook computational complexity, especially for floating-point operations (FLOPs), making them unsuitable for resource-limited devices. Transformer-based models have achieved remarkable success in natural language processing (NLP) and computer vision (CV) tasks, motivating their use in wireless applications. However, their use in indoor localization remains nascent, and directly applying Transformers for indoor localization can be both computationally intensive and exhibit limitations in accuracy. To address these challenges, in this work, we introduce a novel tokenization approach, referred to as Sensor Snapshot Tokenization (SST), which preserves variable-specific representations of power delay profile (PDP) and enhances attention mechanisms by effectively capturing multi-variate correlation. Complementing this, we propose a lightweight Swish-Gated Linear Unit-based Transformer (L-SwiGLU-T) model, designed to reduce computational complexity without compromising localization accuracy. Together, these contributions mitigate the computational burden and dependency on large datasets, making Transformer models more efficient and suitable for resource-constrained scenarios. Experimental results on simulated and real-world datasets demonstrate that SST and L-SwiGLU-T achieve substantial accuracy and efficiency gains, outperforming larger Transformer and CNN baselines by over 40% while using significantly fewer FLOPs and training samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。