用神经网络快速逼近复杂决策优化,提升端到端学习效率
Efficient End-to-End Learning for Decision-Making: A Meta-Optimization Approach
- 设计可学习的神经优化器,通过交替投影保证可行性
- 在电力调度等场景中比传统方法快数倍且规模更大
- 适合需要快速决策的大规模优化问题研究者
端到端学习在预测模型与下游决策任务间建立联系,显著优于仅关注预测误差的传统方法。然而,其计算复杂度高,每次梯度计算需求解昂贵的优化问题。本文提出一种元优化方法,通过神经网络学习高效近似优化算法,大幅降低决策问题求解开销。该方法采用交替投影机制,确保约束可行性,理论证明具有指数收敛、近似保证和泛化界。在真实电力调度(覆盖13个州)、基于地形图的最短路径、多仓库补货等场景中,该方法比现有技术更快、更可扩展。适用于确定性单阶段及两阶段随机优化问题。
原文摘要 · Abstract (English)
End-to-end learning has become a widely applicable and studied problem in training predictive ML models to be aware of their impact on downstream decision-making tasks. These end-to-end models often outperform traditional methods that separate training from the optimization and only myopically focus on prediction error. However, the computational complexity of end-to-end frameworks poses a significant challenge, particularly for large-scale problems. While training an ML model using gradient descent, each time we need to compute a gradient we must solve an expensive optimization problem. We present a meta-optimization method that learns efficient algorithms to approximate optimization problems, dramatically reducing computational overhead of solving the decision problem in general, an aspect we leverage in the training within the end-to-end framework. Our approach introduces a neural network architecture that near-optimally solves optimization problems while ensuring feasibility constraints through alternate projections. We prove exponential convergence, approximation guarantees, and generalization bounds for our learning method. This method offers superior computational efficiency, producing high-quality approximations faster and scaling better with problem size compared to existing techniques. Our approach applies to a wide range of optimization problems including deterministic, single-stage as well as two-stage stochastic optimization problems. We illustrate how our proposed method applies to (1) an electricity generation problem using real data from an electricity routing company coordinating the movement of electricity throughout 13 states, (2) a shortest path problem with a computer vision task of predicting edge costs from terrain maps, (3) a two-stage multi-warehouse cross-fulfillment newsvendor problem, as well as a variety of other newsvendor-like problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。