用连续嵌入空间加速图组合优化,提升泛化与扩展性。
Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization

- 直接在连续嵌入空间预测动作,单次前向传播生成
- 推理速度最快提升16.2倍,泛化能力提高40%
- 适合大规模、复杂依赖的图优化任务研究者
图组合优化(GCO)因许多NP难问题可自然建模为图结构而受到关注,但其组合爆炸使精确方法计算不可行。近年来,强化学习(RL)与图神经网络(GNN)结合显著提升了学习型GCO求解器性能。然而,现有方法在跨不同图实例的泛化能力及随动作空间扩大时的计算可扩展性方面仍受限。为此,我们提出投影代理(projection agents),一种新型的RL-GCO方法,直接在连续的GNN动作嵌入空间中操作,通过一次前向传播预测目标潜变量动作,并解码为有效离散动作。同时,我们通过共享嵌入空间实现不同RL方法间的公平比较。在多种基准测试中,该方法实现最高16.2倍的推理加速和最高40%的泛化性能提升,仅使用简单的最近邻解码即可达成;并首次支持具有超线性决策空间和多重依赖变量的强效RL性能。最后,我们发布LaGCO-RL——一个自动化构建潜行动作空间的Python库,兼容现有RL-GCO方案,推动复现与新基准适配。
原文摘要 · Abstract (English)
Graph combinatorial optimization (GCO) has attracted growing interest, as many NP-hard problems naturally admit graph formulations, yet their combinatorial explosion renders exact methods computationally intractable. Recent advances in Reinforcement Learning (RL) combined with Graph Neural Networks (GNNs) have significantly improved learning-based GCO solvers. However, existing approaches face limitations in both generalization across diverse graph instances and computational scalability as action spaces grow. To address both challenges, we introduce projection agents, a novel RL-GCO approach that operates directly in a continuous GNN-based action embedding space, predicting a desired latent action in a single forward pass and subsequently decoding it into a valid discrete action. Additionally, we enable fair comparison across RL methods through a shared embedding space for both observations and actions. Across diverse benchmarks, our approach achieves up to 16.2x faster inference and up to 40% better generalization than existing solutions using only simple nearest-neighbor decoding, while opening the door to strong RL performance in super-linear decision spaces with multiple interdependent variables. Finally, we release LaGCO-RL, a Python library that automates latent action-space construction and supports existing RL-GCO solutions, promoting reproducibility and adaptation to new GCO benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。