用图神经网络加速随机路径规划,兼顾预算风险与奖励最大化
Solving Stochastic Orienteering Problems with Chance Constraints Using a GNN Powered Monte Carlo Tree Search
- 用消息传递GNN预测每条路径的收益和失败概率,加速搜索
- 在预算约束下实现90%以上成功率,奖励损失低于5%
- 可泛化到未见场景,适合实时路径决策应用
本文提出一种基于图神经网络(GNN)的消息传递方法,结合蒙特卡洛树搜索(MCTS)求解带有机会约束的随机定向问题。在给定旅行预算条件下,算法旨在最大化收集奖励,同时控制超出预算的概率。该方法为在线、可随时中断的算法,通过持续监控剩余预算来决定下一访问节点。其创新在于将MCTS中的回溯阶段由消息传递GNN实现,可同时预测每个可用动作的效用与失败概率,显著提升搜索效率。实验表明,该方法能高效解决复杂实例,奖励损失较低,且具备超越训练数据特征的泛化能力。论文官网、开源代码及补充文档详见ucmercedrobotics.github.io/gnn-sop。
原文摘要 · Abstract (English)
Leveraging the power of a graph neural network (GNN) with message passing, we present a Monte Carlo Tree Search (MCTS) method to solve stochastic orienteering problems with chance constraints. While adhering to an assigned travel budget the algorithm seeks to maximize collected reward while incurring stochastic travel costs. In this context, the acceptable probability of exceeding the assigned budget is expressed as a chance constraint. Our MCTS solution is an online and anytime algorithm alternating planning and execution that determines the next vertex to visit by continuously monitoring the remaining travel budget. The novelty of our work is that the rollout phase in the MCTS framework is implemented using a message passing GNN, predicting both the utility and failure probability of each available action. This allows to enormously expedite the search process. Our experimental evaluation shows that with the proposed method and architecture we manage to efficiently solve complex problem instances while incurring in moderate losses in terms of collected reward. Moreover, we demonstrate how the approach is capable of generalizing beyond the characteristics of the training dataset. The paper's website, open-source code, and supplementary documentation can be found at ucmercedrobotics.github.io/gnn-sop.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。