arXiv:2512.07417cs.LG2025-12中稿 · presentation and p…

用强化学习动态调参,让交通信号灯更智能地应对拥堵。

Adaptive Tuning of Parameterized Traffic Controllers via Multi-Agent Reinforcement Learning

  • 每个路口用独立智能体动态调整信号控制参数,兼顾响应速度与适应性。
  • 在模拟多类型路网中,性能优于固定参数和无控制,且抗干扰更强。
  • 适合交通管理、自动驾驶协同等需要鲁棒控制的场景。

有效的交通控制对缓解交通拥堵至关重要。传统策略如路径诱导和匝道控制常依赖状态反馈控制器,虽简单易反应,但难以应对复杂多变的交通动态。本文提出一种多智能体强化学习框架,各智能体自适应调整个体状态反馈控制器的参数,融合了反馈控制的实时性与强化学习的适应性。通过低频调参而非高频直接决策,提升训练效率的同时保持对交通变化的适应能力。多智能体结构增强了系统鲁棒性,局部控制器可在部分失效时独立运行。在模拟的多类别交通网络上评估,结果表明该框架优于无控制和固定参数反馈控制,性能与单智能体强化学习方法相当,但对扰动更具韧性。

原文摘要 · Abstract (English)

Effective traffic control is essential for mitigating congestion in transportation networks. Conventional traffic management strategies, including route guidance and ramp metering, often rely on state feedback controllers, which are used for their simplicity and reactivity; however, they lack the adaptability required to cope with complex and time-varying traffic dynamics. This paper proposes a multi-agent reinforcement learning (RL) framework in which each agent adaptively tunes the parameters of a state feedback traffic controller, combining the reactivity of state feedback controllers with the adaptability of RL. By tuning parameters at a lower frequency rather than directly determining control inputs at a high frequency, the RL agents achieve improved training efficiency while maintaining adaptability to varying traffic conditions. The multi-agent structure further enhances system robustness, as local controllers can operate independently in the event of partial failures. The proposed framework is evaluated on a simulated multi-class transportation network under varying traffic conditions. Results show that the proposed multi-agent framework outperforms the no-control and fixed-parameter state feedback control cases, while performing on par with the single-agent RL-based adaptive state feedback control, but with much greater resilience to disturbances.

交通控制强化学习多智能体自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。