arXiv:2606.08797cs.LGcs.AI2026-06

用拉格朗日分解提升决策导向学习的可扩展性,大幅降低大规模问题求解成本。

Scaling Decision-Focused Learning to Large Problems with Lagrangian Decomposition

论文配图:Scaling Decision-Focused Learning to Large Problems with Lagrangian Decomposition
图 1 · 摘自论文原文
  • 引入拉格朗日分解与新代理目标函数,实现高效训练
  • 在变量数量为传统方法8倍的大规模问题上表现更优
  • 兼容SPO+和IMLE,支持并行化,适合大规模决策优化场景

决策导向学习在预测-优化问题中展现巨大潜力,尤其适用于模型不明确的情形。然而其实际应用常受高计算开销与可扩展性限制,因每轮训练需对每个样本求解一个约束优化问题。为此,本文提出一种新框架,将拉格朗日分解融入决策导向学习范式,设计新的代理目标及两类损失函数用于评估与训练预测模型。进一步提出两种变体,在计算效率与解质量间提供不同权衡。该框架可无缝集成标准决策导向学习方法(如SPO+与IMLE)。在多维背包问题与二次投资组合优化两个基准测试中,实验表明本方法在保持良好性能的同时具备良好并行性,尤其在包含最多达传统方法8倍变量的大规模实例上持续优于传统方法。代码已开源:https://github.com/corail-research/DFL-LD。

原文摘要 · Abstract (English)

Decision-focused learning has shown great promise for addressing predict-then-optimize problems, particularly in the presence of under-specified models. However, its practical deployment is often hindered by high computational costs and limited scalability, as it requires solving a constrained optimization problem for each training instance at every iteration. To address these challenges, we propose a novel framework that incorporates Lagrangian decomposition into the decision-focused learning paradigm. Specifically, we introduce a new surrogate objective along with two loss functions for evaluating and training the underlying prediction model. We further propose two variants of our approach, which offer different trade-offs between computational efficiency and solution quality. Our framework can be seamlessly integrated with standard decision-focused learning methods, including Smart Predict-then-Optimize (SPO+) and Implicit Maximum Likelihood Estimation (IMLE). Through experiments on two standard benchmarks, the multi-dimensional knapsack problem and quadratic portfolio optimization, we demonstrate that our approach achieves competitive performance while remaining amenable to parallelization. In particular, it consistently outperforms traditional decision-focused learning methods on large-scale instances, involving up to eight times more variables than those typically considered in related work. The implementation is available at https://github.com/corail-research/DFL-LD.

决策优化拉格朗日分解可扩展性预测-优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。