arXiv:2602.02943cs.LG2026-02被引 1

用扩散模型找最坏分布,提升预测决策在异常情况下的鲁棒性。

3D-Learning: Diffusion-Augmented Distributionally Robust Decision-Focused Learning

  • 通过扩散模型参数空间搜索最坏情况分布
  • 在大语言模型资源调度任务中显著优于传统方法
  • 适合需要高可靠性决策的云服务与网络系统

预测后优化(PTO)流程广泛应用于计算与网络系统中,利用机器学习模型预测关键上下文信息以支持下游决策任务,如云大语言模型服务、数据中心需求响应和边缘工作负载调度。然而,这些预测模型在测试时对分布外(OOD)样本敏感,导致预测误差大,进而严重损害决策性能。为应对分布外情况下的泛化挑战,本文提出分布鲁棒决策聚焦学习(DR-DFL)框架,训练模型在最坏分布下优化决策表现。不同于传统分布鲁棒优化(DRO)技术,本文提出扩散增强的分布鲁棒决策聚焦学习(3D-Learning),在扩散模型参数空间内搜索最坏分布。借助扩散模型强大的分布建模能力,3D-Learning 找到与真实数据一致的最坏分布,在平均性能与最坏情况间取得良好平衡。在大语言模型资源调度任务上的实验表明,3D-Learning 在分布外泛化性能上优于现有 DRO 和数据增强方法。

原文摘要 · Abstract (English)

Predict-then-Optimize (PTO) pipelines are widely employed in computing and networked systems, where Machine Learning (ML) models are used to predict critical contextual information for downstream decision-making tasks such as cloud LLM serving, data center demand response, and edge workload scheduling. However, these ML predictors are often vulnerable to out-of-distribution (OOD) samples at test time, leading to significant decision performance degradation due to large prediction errors. To address the generalization challenges under OOD conditions, we present the framework of Distributionally Robust Decision-Focused Learning (DR-DFL), which trains ML models to optimize decision performance under the worst-case distribution. Instead of relying on classical Distributionally Robust Optimization (DRO) techniques, we propose Diffusion-Augmented Distributionally Robust Decision-Focused Learning (3D-Learning), which searches for the worst-case distribution within the parameterized space of a diffusion model. By leveraging the powerful distribution modeling capabilities of diffusion models, 3D-Learning identifies worst-case distributions that remain consistent with real data, achieving a favorable balance between average and worst-case scenarios. Empirical results on an LLM resource provisioning task demonstrate that 3D-Learning outperforms existing DRO and Data Augmentation methods in OOD generalization performance.

决策学习扩散模型鲁棒优化云服务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。