提出DiOpt框架,用扩散模型解决带约束的非凸优化问题。
Diffusion-based learning framework for Constrained Nonconvex Optimization with Weighted Bootstrapped Refinement
- 分两阶段训练:先监督预热,再自举迭代优化
- 在多个任务上同时提升解的质量与约束满足率
- 首个成功将扩散模型用于带约束非凸优化的方法
扩散模型在加速非凸优化求解方面展现出潜力,但现有方法多依赖监督学习且缺乏约束满足机制。本文分析发现,监督式扩散求解器存在分布错位问题——生成解在可行域的概率质量低。为此,提出DiOpt框架,通过双阶段训练实现从噪声到约束区域的有效映射:第一阶段为监督预热,第二阶段为自举迭代优化,逐步提升目标函数值并确保高约束满足度。推理时引入解选择策略以进一步提升最优性。实验表明,DiOpt在多种非凸任务中均优于现有方法,在优化性能和约束满足方面表现卓越。官方页面见 https://dingsht.tech/diopt-webpage。
原文摘要 · Abstract (English)
Recent advances in diffusion models show promising potential to accelerate nonconvex problem solving by leveraging their multimodality. However, most existing diffusion-based optimization approaches rely on supervised learning and lack a mechanism to enforce constraint satisfaction, which is required in real-world applications. In that case, we investigate and theoretically analyze the inherent problem of supervised diffusion solvers and identify the distributional misalignment problem, i.e., the generated solution distribution often exhibits low probability mass on the feasible region. To resolve this issue, we propose DiOpt, a new diffusion-based learning framework for constrained nonconvex optimization, which effectively learns the mapping from noise to the constraint region. Specifically, this framework operates in two distinct phases: an initial warm-start phase, implemented via supervised learning, followed by a bootstrapping training phase. This dual-phase architecture is designed to iteratively refine solutions, thereby improving the objective function with high constraint satisfaction. Finally, we also employ a solution selection technique in inference for better optimality. Notably, DiOpt is the first successful integration of the diffusion solver in constrained nonconvex optimization. Evaluations on diverse nonconvex tasks demonstrate the superiority of DiOpt in both optimality and constraint satisfaction. Our official page is released at https://dingsht.tech/diopt-webpage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。