arXiv:2508.20315cs.LG2025-08综述被引 5

综述多智能体强化学习在智能交通中的应用与挑战

Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey

  • 按协调模式和算法分类,梳理多智能体强化学习框架
  • 覆盖信号控制、自动驾驶协同等核心交通场景
  • 适合研究智能交通与多智能体系统者参考

城市交通日益复杂,对高效、可持续和自适应解决方案的需求使智能交通系统(ITS)成为现代基础设施创新的核心。其核心挑战在于动态、大规模、不确定环境下多个智能体(如交通信号、自动驾驶车辆、车队单元)的自主决策与有效协同。多智能体强化学习(MARL)通过使分布式智能体共同学习最优策略,在个体目标与系统整体效率间取得平衡,展现出巨大潜力。本文系统综述了MARL在ITS中的应用,提出基于协调模式与学习算法的结构化分类体系,涵盖基于价值、基于策略、演员-评论家及通信增强等框架。应用范围包括交通信号控制、联网自动驾驶车辆协同、物流优化及按需出行系统。同时,介绍SUMO、CARLA、CityFlow等常用仿真平台及新兴基准。此外,指出可扩展性、非平稳性、信用分配、通信约束及仿真到现实的迁移差距等核心挑战,仍制约实际部署。

原文摘要 · Abstract (English)

The growing complexity of urban mobility and the demand for efficient, sustainable, and adaptive solutions have positioned Intelligent Transportation Systems (ITS) at the forefront of modern infrastructure innovation. At the core of ITS lies the challenge of autonomous decision-making across dynamic, large scale, and uncertain environments where multiple agents traffic signals, autonomous vehicles, or fleet units must coordinate effectively. Multi Agent Reinforcement Learning (MARL) offers a promising paradigm for addressing these challenges by enabling distributed agents to jointly learn optimal strategies that balance individual objectives with system wide efficiency. This paper presents a comprehensive survey of MARL applications in ITS. We introduce a structured taxonomy that categorizes MARL approaches according to coordination models and learning algorithms, spanning value based, policy based, actor critic, and communication enhanced frameworks. Applications are reviewed across key ITS domains, including traffic signal control, connected and autonomous vehicle coordination, logistics optimization, and mobility on demand systems. Furthermore, we highlight widely used simulation platforms such as SUMO, CARLA, and CityFlow that support MARL experimentation, along with emerging benchmarks. The survey also identifies core challenges, including scalability, non stationarity, credit assignment, communication constraints, and the sim to real transfer gap, which continue to hinder real world deployment.

智能交通多智能体强化学习综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。