arXiv:2511.02331cs.LG2025-11NeurIPS被引 9

RoME让模型跨领域预测优化问题解,性能提升67.7%

RoME: Domain-Robust Mixture-of-Experts for MILP Solution Prediction across Domains

  • 用任务嵌入动态分配问题给专用专家
  • 跨域训练使模型在5个新领域平均提升67.7%
  • 适合需要泛化能力的工业优化场景

混合整数线性规划(MILP)是建模复杂优化问题的核心框架。近年来,基于学习的方法通过预测高质量解显著加速求解器。然而,现有方法多在单一领域训练与评估,难以泛化到未见问题分布,制约了通用学习型求解器的发展。为此,我们提出RoME——一种面向跨域的域鲁棒专家混合框架,通过学习的任务嵌入动态路由问题实例至专用专家。模型采用两层分布鲁棒优化策略:跨域以缓解领域间全局偏移,域内通过扰动任务嵌入增强局部鲁棒性。实验证明,跨域训练不仅提升对未见领域的泛化能力,还通过捕捉更普遍的组合模式提升单域性能。一个在三个领域训练的RoME模型,在五个不同领域上评估时实现平均67.7%的性能提升。此外,在MIPLIB零样本测试中,该预训练模型在真实世界难题上仍表现优异,优于现有学习方法。

原文摘要 · Abstract (English)

Mixed-Integer Linear Programming (MILP) is a fundamental and powerful framework for modeling complex optimization problems across diverse domains. Recently, learning-based methods have shown great promise in accelerating MILP solvers by predicting high-quality solutions. However, most existing approaches are developed and evaluated in single-domain settings, limiting their ability to generalize to unseen problem distributions. This limitation poses a major obstacle to building scalable and general-purpose learning-based solvers. To address this challenge, we introduce RoME, a domain-Robust Mixture-of-Experts framework for predicting MILP solutions across domains. RoME dynamically routes problem instances to specialized experts based on learned task embeddings. The model is trained using a two-level distributionally robust optimization strategy: inter-domain to mitigate global shifts across domains, and intra-domain to enhance local robustness by introducing perturbations on task embeddings. We reveal that cross-domain training not only enhances the model's generalization capability to unseen domains but also improves performance within each individual domain by encouraging the model to capture more general intrinsic combinatorial patterns. Specifically, a single RoME model trained on three domains achieves an average improvement of 67.7% then evaluated on five diverse domains. We further test the pretrained model on MIPLIB in a zero-shot setting, demonstrating its ability to deliver measurable performance gains on challenging real-world instances where existing learning-based approaches often struggle to generalize.

MILP专家混合跨域泛化优化求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。