在无目标数据时,用相关分布建模不确定性,实现稳健决策
Robust Out-of-Distribution Stochastic Optimization

- 假设数据分布来自元分布,通过核空间学习可调保守度的不确定集
- 在未见分布下表现优异,小样本或多源情况下仍具鲁棒性
- 适合缺乏历史数据但有相似领域信息的决策场景
基于不确定性的数据驱动决策通常假定能获取未知目标分布的历史数据。然而,在决策前可能完全无法访问目标分布的数据。为应对这一挑战,我们提出一种新型数据驱动框架——鲁棒分布外随机优化,有效利用相关分布实现对未知分布的稳健决策。该框架的核心假设是所有数据分布均从分布的元分布中随机生成。为刻画分布生成的不确定性,我们在再生核希尔伯特空间(RKHS)中从相关分布数据学习一个可调节保守程度的数据驱动不确定集,并将其融入极小极大随机规划以获得稳健决策。值得注意的是,在分布生成随机性的前提下,我们建立了不确定集及解的严格分布外泛化保证。为降低在RKHS中求解的难度,提出了具有可证明次优性上界的近似参数化方法和行生成策略。在多品类报童问题与投资组合优化上的大量数值实验表明,即使仅有少量或中等数量的相关数据源,该框架在未见数据分布下的表现也显著优于现有方法。
原文摘要 · Abstract (English)
Data-driven decision-making under uncertainty typically presumes the collection of historical data from an unknown target probability distribution. However, one may have no access to any data from the target distribution prior to decision-making. To address this challenge, we propose robust out-of-distribution stochastic optimization, a novel data-driven framework that effectively utilizes relevant data distributions for robust decision-making under unseen distributions. A key feature of our framework is that all data distributions are assumed to be randomly generated from a meta-distribution over distributions. To describe uncertainty in distribution generation, we propose to learn a data-driven uncertainty set in a reproducing kernel Hilbert space (RKHS) from relevant data distributions, with adjustable conservatism. We then incorporate this set into a min-max stochastic program to derive robust decisions. Notably, under randomness of distribution generation, we establish rigorous out-of-distribution generalization guarantees for the uncertainty set as well as the solution. To ease problem-solving in RKHS, an approximate parametrization with a provably bounded suboptimality and a row generation strategy are presented. Extensive numerical experiments on multi-item newsvendor and portfolio optimization demonstrate the superior out-of-distribution performance of our decision-making framework under unseen data distribution, even when only a small or moderate number of relevant sources are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。