arXiv:2510.25986cs.LGmath.OC2025-10被引 3

提出可微优化新框架,让复杂优化问题轻松支持自动求导。

A General and Streamlined Differentiable Optimization Framework

  • 基于KKT系统直接求解,统一处理凸与非凸优化问题。
  • 支持参数级求导,可同时在多约束中追踪任意参数变化影响。
  • 无缝接入Julia生态,适合需要优化建模与学习结合的研究者。

对带约束优化问题进行求导在学习、控制和大规模决策系统中日益重要,但实际应用受限于求解器专用性与接口不兼容。本文提出一个通用且简洁的框架——更新版DiffOpt.jl,将建模与求导统一于Julia优化栈中。该框架在标准正则性假设下,通过求解KKT系统,计算平滑、可能非凸问题的前向与反向梯度。其原生支持JuMP的参数中心化API,允许用户声明命名参数并直接获取对这些参数的导数,即使参数出现在多个约束与目标中,无需繁琐的系数级维护。我们展示了在经济调度、带锥风险约束的均值-方差投资组合选择及非线性机器人逆运动学等模型上的应用。两篇配套研究进一步验证其规模化价值:基于梯度的能源市场策略投标方法,以及利用求解器精确敏感度的端到端优化代理的Sobolev训练。结果表明,可微优化可作为实验、学习、校准与设计的常规工具,无需偏离标准的JuMP建模方式,同时保留对广泛求解器生态的访问能力。

原文摘要 · Abstract (English)

Differentiating through constrained optimization problems is increasingly central to learning, control, and large-scale decision-making systems, yet practical integration remains challenging due to solver specialization and interface mismatches. This paper presents a general and streamlined framework-an updated DiffOpt.jl-that unifies modeling and differentiation within the Julia optimization stack. The framework computes forward - and reverse-mode solution and objective sensitivities for smooth, potentially nonconvex programs by differentiating the KKT system under standard regularity assumptions. A first-class, JuMP-native parameter-centric API allows users to declare named parameters and obtain derivatives directly with respect to them - even when a parameter appears in multiple constraints and objectives - eliminating brittle bookkeeping from coefficient-level interfaces. We illustrate these capabilities on convex and nonconvex models, including economic dispatch, mean-variance portfolio selection with conic risk constraints, and nonlinear robot inverse kinematics. Two companion studies further demonstrate impact at scale: gradient-based iterative methods for strategic bidding in energy markets and Sobolev-style training of end-to-end optimization proxies using solver-accurate sensitivities. Together, these results demonstrate that differentiable optimization can be deployed as a routine tool for experimentation, learning, calibration, and design-without deviating from standard JuMP modeling practices and while retaining access to a broad ecosystem of solvers.

可微优化JuliaKKT自动求导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。