arXiv:2503.05175math.OCcs.LG2025-03

用自监督损失训练神经网络,快速求解不确定环境下的约束优化问题。

Self-Supervised Penalty-Based Learning for Robust Constrained Optimization

  • 基于精确罚函数设计自监督损失,无需预解实例即可训练。
  • 推理速度远超传统求解器,且可调节惩罚参数平衡解的优劣与鲁棒性。
  • 适用于连续与离散变量的鲁棒组合优化,适合需要实时决策的场景。

我们提出一种参数化约束鲁棒优化的新方法,基于自监督的罚函数损失进行学习。与需要预解实例的监督学习不同,该方法利用优化中的精确罚方法构造自定义损失函数,训练神经网络以近似参数化最优解映射。针对鲁棒组合优化问题,通过在神经网络最后一层引入混合整数域上的代理线性代价及其光滑近似,进一步提升适用性。我们在三类应用上测试:含连续变量的多维背包问题、含离散变量的组合多维背包问题,以及库存管理问题。结果表明,该自监督方法能有效学习神经网络近似解,其推理时间显著低于传统求解器的计算时间;同时,通过调节罚参数,可灵活权衡解的次优性与鲁棒可行性。

原文摘要 · Abstract (English)

We propose a new methodology for parameterized constrained robust optimization, an important class of optimization problems under uncertainty, based on learning with a self-supervised penalty-based loss function. Whereas supervised learning requires pre-solved instances for training, our approach leverages a custom loss function derived from the exact penalty method in optimization to learn an approximation, typically defined by a neural network model, of the parameterized optimal solution mapping. Additionally, we adapt our approach to robust constrained combinatorial optimization problems by incorporating a surrogate linear cost over mixed integer domains, and a smooth approximations thereof, into the final layer of the network architecture. We perform computational experiments to test our approach on three different applications: multidimensional knapsack with continuous variables, combinatorial multidimensional knapsack with discrete variables, and an inventory management problem. Our results demonstrate that our self-supervised approach is able to effectively learn neural network approximations whose inference time is significantly smaller than the computation time of traditional solvers for this class of robust optimization problems. Furthermore, our results demonstrate that by varying the penalty parameter we are able to effectively balance the trade-off between sub-optimality and robust feasibility of the obtained solutions.

鲁棒优化神经网络自监督学习约束优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。