用大模型分析卫星信号干扰,提升定位可靠性。
Multimodal-to-Text Prompt Engineering in Large Language Models Using Feature Embeddings for GNSS Interference Characterization
- 通过特征嵌入与提示工程,让大模型理解复杂干扰环境。
- 在干扰分类任务中超越现有机器学习模型表现。
- 适合从事车载定位、信号处理的工程师参考。
大型语言模型(LLMs)在自然语言处理、信息检索等领域广泛应用,但其在信号处理任务中仍较少被探索,尤其在全局导航卫星系统(GNSS)干扰监测方面。由于干扰源多样且受多径效应、传感器差异及星座配置影响,准确识别和分类干扰极具挑战。本文从大规模GNSS数据中提取特征,利用LLaVA模型从知识库中检索相关信息,结合提示工程解析干扰与环境因素,并采用t-SNE分析特征嵌入。结果表明,该方法可在GNSS场景中实现视觉与逻辑推理。此外,所提流程在干扰分类任务上优于当前最优机器学习模型。
原文摘要 · Abstract (English)
Large language models (LLMs) are advanced AI systems applied across various domains, including NLP, information retrieval, and recommendation systems. Despite their adaptability and efficiency, LLMs have not been extensively explored for signal processing tasks, particularly in the domain of global navigation satellite system (GNSS) interference monitoring. GNSS interference monitoring is essential to ensure the reliability of vehicle localization on roads, a critical requirement for numerous applications. However, GNSS-based positioning is vulnerable to interference from jamming devices, which can compromise its accuracy. The primary objective is to identify, classify, and mitigate these interferences. Interpreting GNSS snapshots and the associated interferences presents significant challenges due to the inherent complexity, including multipath effects, diverse interference types, varying sensor characteristics, and satellite constellations. In this paper, we extract features from a large GNSS dataset and employ LLaVA to retrieve relevant information from an extensive knowledge base. We employ prompt engineering to interpret the interferences and environmental factors, and utilize t-SNE to analyze the feature embeddings. Our findings demonstrate that the proposed method is capable of visual and logical reasoning within the GNSS context. Furthermore, our pipeline outperforms state-of-the-art machine learning models in interference classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。