arXiv:2410.20680eess.SPcs.LG2024-10被引 5

用图像和信道数据联合训练定位模型,提升无标签数据利用率。

Multi-modal Data based Semi-Supervised Learning for Vehicle Positioning

  • 用图像中的方位角作为无标签信道数据的伪标签进行预训练。
  • 相比未预训练基线,定位误差降低最高达30%。
  • 适合有摄像头与无线信号数据的智能交通系统应用。

本文设计了一种基于多模态数据的半监督学习(SSL)框架,联合利用信道状态信息(CSI)数据和RGB图像实现车辆定位。考虑一种由基站(BS)确定车辆位置的室外定位系统,该基站配备多个摄像头,可采集大量无标签的CSI数据和少量带标签的车辆CSI数据,以及摄像头拍摄的图像。尽管图像仅包含车辆的部分信息(如方位角),但无标签的CSI数据与其方位角、基站与车辆间的距离关系均未知,因此无法直接将图像作为无标签CSI数据的标签来训练定位模型。为充分利用无标签数据与图像,提出一个包含预训练阶段和下游训练阶段的SSL框架:在预训练阶段,将图像中获取的方位角视为无标签CSI数据的标签以预训练定位模型;在下游训练阶段,使用少量准确标注车辆位置的有标签数据重新训练模型。仿真结果表明,与未预训练的基线方法相比,所提方法可将定位误差降低最高达30%。

原文摘要 · Abstract (English)

In this paper, a multi-modal data based semi-supervised learning (SSL) framework that jointly use channel state information (CSI) data and RGB images for vehicle positioning is designed. In particular, an outdoor positioning system where the vehicle locations are determined by a base station (BS) is considered. The BS equipped with several cameras can collect a large amount of unlabeled CSI data and a small number of labeled CSI data of vehicles, and the images taken by cameras. Although the collected images contain partial information of vehicles (i.e. azimuth angles of vehicles), the relationship between the unlabeled CSI data and its azimuth angle, and the distances between the BS and the vehicles captured by images are both unknown. Therefore, the images cannot be directly used as the labels of unlabeled CSI data to train a positioning model. To exploit unlabeled CSI data and images, a SSL framework that consists of a pretraining stage and a downstream training stage is proposed. In the pretraining stage, the azimuth angles obtained from the images are considered as the labels of unlabeled CSI data to pretrain the positioning model. In the downstream training stage, a small sized labeled dataset in which the accurate vehicle positions are considered as labels is used to retrain the model. Simulation results show that the proposed method can reduce the positioning error by up to 30% compared to a baseline where the model is not pretrained.

车辆定位半监督学习多模态融合信道状态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。