提出稀疏非线性加速投影方法,提升物理约束生成模型的推理速度。
SNAP-FM: Sparse Nonlinear Accelerated Projection for Physics-Constrained Generative Modeling

- 利用样本批处理与局部微分方程耦合,暴露投影子问题的块稀疏结构
- 在多维线性和非线性约束下,实现比传统方法更快的约束投影计算
- 适合需要高精度物理一致性、且关注推理效率的科学机器学习研究者
生成模型已成为物理模拟的可扩展代理,但其输出无法保证遵守守恒律、边界条件和非线性不变量。约束采样在推理时精确施加这些约束,无需重新训练,但计算开销大:投影、修正和轨迹优化步骤需重复执行,尤其在非线性约束下代价高昂。标准机器学习框架加剧此问题:密集张量代数与稀疏求解器组合能力有限,掩盖了物理约束天然带来的结构,使高效批量非线性优化难以实现。本文通过利用样本批处理与局部偏微分方程耦合在投影子问题中产生的结构——即块稀疏雅可比矩阵与KKT系统——借助ExaModels.jl暴露该结构,并使用MadNLP.jl与GPU稀疏分解求解稀疏非线性规划。应用于物理约束流匹配(PCFM),在含线性、非线性、一维及二维约束的PDE基准测试中,该方法显著加速了非线性约束投影,同时保持约束满足。结果表明,稀疏GPU非线性优化是科学机器学习中约束生成采样的实用基础。
原文摘要 · Abstract (English)
Generative models have emerged as scalable surrogates for physical simulation, yet they offer no guarantee that their outputs respect the conservation laws, boundary conditions, and nonlinear invariants that govern the underlying physics. Constrained sampling closes this gap, enforcing such constraints exactly at inference time without retraining, but at a computational cost: projection, correction, and trajectory-optimization steps are repeated during sampling, with these steps becoming expensive for nonlinear constraints. Standard ML frameworks exacerbate this: their dense tensor algebra and limited sparse solver composability obscure the structure that physical constraints naturally induce, making efficient batched nonlinear optimization difficult to realize in practice. We address this bottleneck by exploiting the structure that sample-wise batching and local PDE couplings induce in the projection subproblems -- namely, block-sparse Jacobian and KKT systems -- exposing this structure using ExaModels.jl and solving the resulting sparse nonlinear programs with MadNLP.jl and GPU sparse factorization. Applied to Physics-Constrained Flow Matching (PCFM), on PDE benchmarks with linear, nonlinear, one-dimensional, and two-dimensional constraints, this approach accelerates nonlinear constraint projection while maintaining constraint satisfaction. These results show that sparse GPU nonlinear optimization is a practical foundation for constrained generative sampling in scientific machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。