UniCO用统一模型解决多种组合优化问题,只需少量微调就能泛化到新任务。
UniCO: Towards a Unified Model for Combinatorial Optimization Problems
- 将优化过程建模为马尔可夫决策过程,用Transformer处理序列化轨迹数据
- 在10个不同组合优化问题上验证,支持零样本和少样本泛化能力
- 适合想用单一框架解决多类优化问题的研究者或工程应用
组合优化(CO)涵盖众多现实场景中的问题。尽管学习方法在特定问题上取得进展,但能统一处理多种CO问题的单一架构与参数集仍难实现。本文提出UniCO,一种统一求解各类组合优化问题的模型。受下一个词预测成功的启发,将每个问题求解过程建模为马尔可夫决策过程(MDP),对相应序列轨迹数据进行分词,并采用Transformer骨干网络训练。为减少轨迹数据的标记长度,提出CO前缀设计,聚合静态问题特征;为应对MDP中状态与动作标记的异质性,采用两阶段自监督学习:先训练动态预测模型,再用于后续策略生成。在10个不同组合优化问题上的实验表明,UniCO具备强泛化能力,可在极少微调下适应未见过的新问题,甚至实现少样本或零样本性能。该框架为现有针对单一问题优化的神经组合优化方法提供了有力补充。
原文摘要 · Abstract (English)
Combinatorial Optimization (CO) encompasses a wide range of problems that arise in many real-world scenarios. While significant progress has been made in developing learning-based methods for specialized CO problems, a unified model with a single architecture and parameter set for diverse CO problems remains elusive. Such a model would offer substantial advantages in terms of efficiency and convenience. In this paper, we introduce UniCO, a unified model for solving various CO problems. Inspired by the success of next-token prediction, we frame each problem-solving process as a Markov Decision Process (MDP), tokenize the corresponding sequential trajectory data, and train the model using a transformer backbone. To reduce token length in the trajectory data, we propose a CO-prefix design that aggregates static problem features. To address the heterogeneity of state and action tokens within the MDP, we employ a two-stage self-supervised learning approach. In this approach, a dynamic prediction model is first trained and then serves as a pre-trained model for subsequent policy generation. Experiments across 10 CO problems showcase the versatility of UniCO, emphasizing its ability to generalize to new, unseen problems with minimal fine-tuning, achieving even few-shot or zero-shot performance. Our framework offers a valuable complement to existing neural CO methods that focus on optimizing performance for individual problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。