用双层强化学习优化冬季道路除雪,提升效率与环保水平
Bi-level RL-Heuristic Optimization for Real-world Winter Road Maintenance
- 上层用强化学习分区域并分配资源,下层优化车辆路径
- 最大行驶时间低于2小时,碳排放和成本显著降低
- 适合交通管理、智能物流等实际运维场景
冬季道路维护对公共安全和环境影响至关重要,但现有方法难以高效处理大规模路径规划问题,且多依赖人工决策。本研究提出一种新型可扩展的双层优化框架,在英国主干道网络(M25、M6、A1)及周边连接路网的真实运营数据上验证。上层采用强化学习(RL)代理将道路网络划分为可管理的簇,并从多个维修站最优分配资源;下层在每簇内求解多目标车辆路径问题(VRP),最小化最大车辆行驶时间与总碳排放。相比现有方法,该框架能高效处理真实大规模网络,显式考虑车辆约束、站点容量与路段需求。实验结果表明,工作量更均衡,最大行驶时间低于2小时阈值,碳排放减少,成本大幅下降。研究展示了先进人工智能驱动的双层优化如何直接提升交通与物流的实际决策能力。
原文摘要 · Abstract (English)
Winter road maintenance is critical for ensuring public safety and reducing environmental impacts, yet existing methods struggle to manage large-scale routing problems effectively and mostly reply on human decision. This study presents a novel, scalable bi-level optimization framework, validated on real operational data on UK strategic road networks (M25, M6, A1), including interconnected local road networks in surrounding areas for vehicle traversing, as part of the highway operator's efforts to solve existing planning challenges. At the upper level, a reinforcement learning (RL) agent strategically partitions the road network into manageable clusters and optimally allocates resources from multiple depots. At the lower level, a multi-objective vehicle routing problem (VRP) is solved within each cluster, minimizing the maximum vehicle travel time and total carbon emissions. Unlike existing approaches, our method handles large-scale, real-world networks efficiently, explicitly incorporating vehicle-specific constraints, depot capacities, and road segment requirements. Results demonstrate significant improvements, including balanced workloads, reduced maximum travel times below the targeted two-hour threshold, lower emissions, and substantial cost savings. This study illustrates how advanced AI-driven bi-level optimization can directly enhance operational decision-making in real-world transportation and logistics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。