arXiv:2604.16612cs.LG2026-04

用联邦学习+大模型实现隐私保护的可解释交通流预测

FedLLM: A Privacy-Preserving Federated Large Language Model for Explainable Traffic Flow Prediction

论文配图:FedLLM: A Privacy-Preserving Federated Large Language Model for Explainable Traffic Flow Prediction
图 1 · 摘自论文原文
  • 通过轻量级参数交换实现跨区域协作训练,保护数据隐私
  • 在真实交通数据上提升预测精度,15-60分钟短时预测效果更优
  • 支持非独立同分布场景,输出结果结构清晰、可解释

交通预测在智能交通系统中至关重要,支撑实时决策、拥堵管理与长期规划。现有方法多依赖集中式数据,使用数值表示且可解释性差。尽管大语言模型(LLM)提升了推理能力,但通常假设数据集中,未充分考虑真实交通系统的分布式和异构特性。本文提出FedLLM(联邦大语言模型),一种面向可解释多时段短期交通流预测(15-60分钟)的隐私保护分布式框架。其核心贡献包括:1)基于复合选择得分(CSS)的数据驱动高速公路选择,捕捉不同交通区域的结构多样性;2)在结构化交通提示词上微调领域适配的LLM,编码空间、时间与统计上下文;3)联邦学习框架支持异构客户端间协作训练,仅交换轻量级LoRA适配器参数;4)结构化提示表示支持上下文推理与跨区域泛化。该设计使各客户端在本地学习交通模式的同时,通过高效参数交换参与全局模型训练,降低通信开销并保持数据私密。实验表明,FedLLM在非独立同分布条件下优于集中式基线模型,同时生成结构化、可解释的输出。结果表明,结合联邦学习与领域适配大模型在可扩展、隐私友好且可解释的交通预测中具有巨大潜力。

原文摘要 · Abstract (English)

Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most spatio-temporal models are trained on centralized data, rely on numerical representations, and offer limited explainability. Recent Large Language Model (LLM) methods improve reasoning capabilities but typically assume centralized data availability and do not fully capture the distributed and heterogeneous nature of real-world traffic systems. To address these challenges, this study proposes FedLLM (Federated LLM), a privacy-preserving and distributed framework for explainable multi-horizon short-term traffic flow prediction (15-60 minutes). The framework introduces four key contributions: 1) a Composite Selection Score (CSS) for data-driven freeway selection that captures structural diversity across traffic regions 2) a domain-adapted LLM fine-tuned on structured traffic prompts encoding spatial, temporal, and statistical context 3) FedLLM framework, that enables collaborative training across heterogeneous clients while exchanging only lightweight LoRA adapter parameters, 4) a structured prompt representation that supports contextual reasoning and cross-region generalization. The FedLLM design allows each client to learn from local traffic patterns while contributing to a shared global model through efficient parameter exchange, reducing communication overhead and keeping data private. This setup supports learning under non-IID traffic distributions. Experimental results show that FedLLM achieves improved predictive performance over centralized baselines, while producing structured and explainable outputs. These findings highlight the potential of combining FL with domain-adapted LLMs for scalable, privacy-aware, and explainable traffic prediction.

联邦学习交通预测大模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。