arXiv:2510.13444cs.LGcs.AI2025-10被引 2

用Transformer预测最小单项式基,加速多项式非负性验证

Neural Sum-of-Squares: Certifying the Nonnegativity of Polynomials with Transformers

  • 用Transformer学习预测最小单项式基,减少SDP规模
  • 实测速度比现有方法快100倍以上,解决部分历史难题
  • 适合需要快速验证多项式非负性的优化与控制领域研究者

多项式非负性认证是已知的NP难问题,广泛应用于非凸优化、控制、机器人等领域。一个充分条件是平方和(SOS)性质,即多项式可表示为其他多项式的平方和。但实际中验证SOS性质计算成本高,常需求解维度随单项式基大小平方增长的半定规划(SDP),因此人们提出多种缩减单项式基大小的方法。本文首次引入学习增强型算法来认证SOS性质:训练Transformer模型预测给定多项式的近似最小单项式基,显著缩小对应SDP规模。整体方法包含三个关键部分:生成超1亿个SOS多项式的高效训练数据集,设计并训练相应Transformer架构,以及系统性回退机制以保证正确终止,并进行理论分析。在200多个基准数据集上验证,相比最先进求解器实现超过100倍加速,且解决了部分竞争方法无法处理的实例。研究结果为提升SOS编程的实际可扩展性提供了新思路。

原文摘要 · Abstract (English)

Certifying nonnegativity of polynomials is a well-known NP-hard problem with direct applications spanning non-convex optimization, control, robotics, and beyond. A sufficient condition for nonnegativity is the Sum of Squares (SOS) property, i.e., it can be written as a sum of squares of other polynomials. In practice, however, certifying the SOS criterion remains computationally expensive and often involves solving a Semidefinite Program (SDP), whose dimensionality grows quadratically in the size of the monomial basis of the SOS expression; hence, various methods to reduce the size of the monomial basis have been proposed. In this work, we introduce the first learning-augmented algorithm to certify the SOS criterion. To this end, we train a Transformer model that predicts an almost-minimal monomial basis for a given polynomial, thereby drastically reducing the size of the corresponding SDP. Our overall methodology comprises three key components: efficient training dataset generation of over 100 million SOS polynomials, design and training of the corresponding Transformer architecture, and a systematic fallback mechanism to ensure correct termination, which we analyze theoretically. We validate our approach on over 200 benchmark datasets, achieving speedups of over $100\times$ compared to state-of-the-art solvers and enabling the solution of instances where competing approaches fail. Our findings provide novel insights towards transforming the practical scalability of SOS programming.

SOS编程Transformer非负性验证优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。