用专家混合框架提升大规模交通信号控制的泛化能力
CROSS: A Mixture-of-Experts Reinforcement Learning Framework for Generalizable Large-Scale Traffic Signal Control
- 引入预测对比聚类识别交通模式,增强表征能力
- 设计场景自适应专家模块,实现策略灵活专精
- 在真实与合成数据上均优于现有方法,适合复杂路网
近年来,机器人、自动化与人工智能的发展推动了城市交通系统向未来智慧城市中的自主运行迈进,其中自适应交通信号控制(ATSC)通过动态优化信号相位缓解拥堵、提升通行效率。然而,由于网络中路口拓扑多样、交通需求高度动态复杂,实现高效且可泛化的大型ATSC仍是重大挑战。现有基于强化学习的方法通常采用单一共享策略,其表达能力有限,难以捕捉多样的交通动态并推广至未见环境。为此,我们提出CROSS,一种基于专家混合(MoE)的去中心化强化学习框架,用于通用的大型交通信号控制。首先引入预测对比聚类(PCC)模块,通过预测短时状态转移识别潜在交通模式,并结合聚类与对比学习增强模式级表征。进一步设计场景自适应MoE模块,在共享策略基础上引入多个专家,实现策略的自适应专业化与更灵活的场景适配。我们在SUMO仿真器中对合成及真实交通数据集进行了大量实验。相比顶尖基线,CROSS在性能与泛化性上均表现更优,通过提升对多样化交通场景的表征能力实现了突破。
原文摘要 · Abstract (English)
Recent advances in robotics, automation, and artificial intelligence have enabled urban traffic systems to operate with increasing autonomy towards future smart cities, powered in part by the development of adaptive traffic signal control (ATSC), which dynamically optimizes signal phases to mitigate congestion and optimize traffic. However, achieving effective and generalizable large-scale ATSC remains a significant challenge due to the diverse intersection topologies and highly dynamic, complex traffic demand patterns across the network. Existing RL-based methods typically use a single shared policy for all scenarios, whose limited representational capacity makes it difficult to capture diverse traffic dynamics and generalize to unseen environments. To address these challenges, we propose CROSS, a novel Mixture-of-Experts (MoE)-based decentralized RL framework for generalizable ATSC. We first introduce a Predictive Contrastive Clustering (PCC) module that forecasts short-term state transitions to identify latent traffic patterns, followed by clustering and contrastive learning to enhance pattern-level representation. We further design a Scenario-Adaptive MoE module that augments a shared policy with multiple experts, thus enabling adaptive specialization and more flexible scenario-specific strategies. We conduct extensive experiments in the SUMO simulator on both synthetic and real-world traffic datasets. Compared with state-of-the-art baselines, CROSS achieves superior performance and generalization through improved representation of diverse traffic scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。