用开源大模型实现低延迟、高隐私的智能交通预测。
Open-Source LLM-Driven Federated Transformer for Predictive IoV Management
- 结合边缘与云端,用动态提示优化提升预测精度。
- 在真实数据上达到99.86%准确率,合成数据表现优异。
- 适合关注隐私保护与可扩展性的智慧交通研究者。
车联网(IoV)中连接车辆的激增带来了可扩展性、实时性和隐私保护方面的严峻挑战。现有集中式方案常因高延迟、扩展性差及依赖专有AI模型而受限,尤其在动态和隐私敏感环境中难以部署。同时,大语言模型(LLMs)在车载系统中的应用,特别是提示优化与联邦环境下的有效利用,仍缺乏探索。为此,我们提出联邦提示优化交通Transformer(FPoTT),利用开源LLM实现预测性IoV管理。FPoTT引入动态提示优化机制,迭代改进文本提示以增强轨迹预测;采用双层联邦学习架构,结合轻量边缘模型实现实时推理与云侧LLM保持全局智能。引入基于Transformer的合成数据生成器,以NGSIM格式扩充多样化、高保真交通场景。大量评估表明,使用EleutherAI Pythia-1B的FPoTT在真实数据上实现99.86%预测准确率,同时在合成数据集上保持高性能。结果证明开源LLM在构建安全、自适应、可扩展的IoV管理方面具有巨大潜力,为智能交通生态提供一种有前景的替代方案。
原文摘要 · Abstract (English)
The proliferation of connected vehicles within the Internet of Vehicles (IoV) ecosystem presents critical challenges in ensuring scalable, real-time, and privacy-preserving traffic management. Existing centralized IoV solutions often suffer from high latency, limited scalability, and reliance on proprietary Artificial Intelligence (AI) models, creating significant barriers to widespread deployment, particularly in dynamic and privacy-sensitive environments. Meanwhile, integrating Large Language Models (LLMs) in vehicular systems remains underexplored, especially concerning prompt optimization and effective utilization in federated contexts. To address these challenges, we propose the Federated Prompt-Optimized Traffic Transformer (FPoTT), a novel framework that leverages open-source LLMs for predictive IoV management. FPoTT introduces a dynamic prompt optimization mechanism that iteratively refines textual prompts to enhance trajectory prediction. The architecture employs a dual-layer federated learning paradigm, combining lightweight edge models for real-time inference with cloud-based LLMs to retain global intelligence. A Transformer-driven synthetic data generator is incorporated to augment training with diverse, high-fidelity traffic scenarios in the Next Generation Simulation (NGSIM) format. Extensive evaluations demonstrate that FPoTT, utilizing EleutherAI Pythia-1B, achieves 99.86% prediction accuracy on real-world data while maintaining high performance on synthetic datasets. These results underscore the potential of open-source LLMs in enabling secure, adaptive, and scalable IoV management, offering a promising alternative to proprietary solutions in smart mobility ecosystems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。