用可微投影确保神经网络解满足约束,无需标注数据即可训练。
Differentiable Projection-based Learn to Optimize in Wireless Network-Part I: Convex Constrained (Non-)Convex Programming
- 通过可微投影将神经网络输出映射到可行域,保证约束严格成立。
- 在多个非凸优化问题上实现100%解的可行性,且收敛速度快。
- 适合需要高可靠性约束满足的无线网络优化场景。
本文针对一类具有通用凸约束的(非)凸优化问题,这类问题因内在非凸性与多样性,传统方法难以高效求解。基于神经网络的方法虽具潜力,但受限于有限容量网络生成不可行解,且缺乏有效训练机制。为此,我们提出一种基于投影的方法:将任意不可行的神经网络输出投影至可行域,严格保障约束满足,同时保留网络优化能力。进一步推导出原始输出与投影后输出的目标函数值及其对网络参数的梯度,支持无标签(自监督)训练,降低对标注数据依赖,提升可扩展性。实验表明,该方法在各类问题中均能稳定保证解的可行性。
原文摘要 · Abstract (English)
This paper addresses a class of (non-)convex optimization problems subject to general convex constraints, which pose significant challenges for traditional methods due to their inherent non-convexity and diversity. Conventional convex optimization-based solvers often struggle to efficiently handle these problems in their most general form. While neural network (NN)-based approaches offer a promising alternative, ensuring the feasibility of NN-generated solutions and effectively training the NN remain key hurdles, largely because finite-capacity networks can produce infeasible outputs. To overcome these issues, we propose a projection-based method that projects any infeasible NN output onto the feasible domain, thus guaranteeing strict adherence to the constraints without compromising the NN's optimization capability. Furthermore, we derive the objective function values for both the raw NN outputs and their projected counterparts, along with the gradients of these values with respect to the NN parameters. This derivation enables label-free (unsupervised) training, reducing reliance on labeled data and improving scalability. Experimental results demonstrate that the proposed projection-based method consistently ensures feasibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。