Integer优化有时比连续优化更省样本,有时更费,取决于问题结构。
Sample Complexity of Stochastic Optimization with Integer Variables
- 基于ℓ∞球的Lipschitz目标,整数非凸优化样本复杂度与线性规划一致。
- 在ℓ₂球上,特定情况下整数优化所需样本比连续优化更少。
- 强凸光滑问题中,整数优化需Ω(1/ε²)样本,远高于连续的O(1/ε)。
我们建立了整数变量随机优化的样本复杂度理论,旨在理解其与连续优化的差异。结果表明:1)在ℓ∞球子集上的Lipschitz目标下,一般混合整数非凸优化的统计复杂度与仅有边界约束的随机线性优化完全相同;2)在ℓ₂球子集上,我们证明了在某些情形下整数优化所需样本量严格小于连续设置,为此还首次给出了非凸连续随机优化的紧致样本复杂度结果;3)对于强凸光滑目标,整数优化的统计复杂度显著高于连续情况,具体为:求ε-近似解至少需要Ω(1/ε²)样本,而连续优化仅需O(1/ε),该结果与现有文献一致。
原文摘要 · Abstract (English)
We establish sample complexity results for stochastic optimization over the integers, especially with a view to understand the complexity with respect to the corresponding continuous optimization problem. We show that integer optimization can sometimes require strictly more samples and sometimes strictly smaller number of samples, depending on the structure of the objective and constraints. 1. For Lipschitz objectives over subsets of the $\ell_\infty$ ball, the statistical complexity of general stochastic mixed-integer, nonlinear, nonconvex optimization is exactly the same as stochastic linear optimization with just bound constraints. 2. For Lipschitz objectives over subsets of the $\ell_2$ ball, we show that integer optimization can require strictly *smaller* sample size compared to the continuous setting in a certain regime. To get to this result, we also establish tight sample complexity results for nonconvex continuous stochastic optimization which, to the best of our knowledge, do not appear in prior work. 3. For strongly convex, smooth objectives, integer optimization has high statistical complexity compared to the continuous setting. In particular, we show that integer optimization requires $Ω(1/ε^2)$ samples to report an $ε$-approximate solution, compared to the well-known $O(1/ε)$ sample complexity from the continuous optimization literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。