arXiv:2511.21414cs.LGcs.NA2025-11

用少参数多项式网络实现高效函数逼近,精度与稳定性显著优于深度网络。

SUPN: Shallow Universal Polynomial Networks

  • 用单层可学习系数的多项式替代多层神经网络,减少参数量
  • 相同参数下,误差和波动降低一个数量级,逼近速度与最优多项式一致
  • 适合对模型可解释性、泛化稳定性要求高的场景

深度神经网络(DNNs)和柯尔莫哥洛夫-阿诺德网络(KANs)因灵活性和表达能力广受欢迎,但通常需要大量可训练参数才能获得良好逼近效果。过多参数不仅降低模型透明度,还扩大优化空间,易陷入泛化性能差异大的局部极小值,导致初始化对测试性能影响显著。为此,我们提出浅层通用多项式网络(SUPN),将除最后一层外的所有隐藏层替换为带可学习系数的单项式层,融合深度网络与多项式的优点,在极少参数下仍具备足够表达力。我们证明了SUPN的收敛速率与同阶最优多项式逼近一致,并推导出准最优参数的显式公式。通过涵盖一维、二维、十维函数的超大规模数值实验(超过13,000个模型训练),在目标函数上,给定相同可训练参数数时,SUPN的逼近误差与方差通常比DNN和KAN低一个数量级;在非光滑函数上,甚至优于传统多项式投影。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) and Kolmogorov-Arnold networks (KANs) are popular methods for function approximation due to their flexibility and expressivity. However, they typically require a large number of trainable parameters to produce a suitable approximation. Beyond making the resulting network less transparent, overparameterization creates a large optimization space, likely producing local minima in training that have quite different generalization errors. In this case, network initialization can have an outsize impact on the model's out-of-sample accuracy. For these reasons, we propose shallow universal polynomial networks (SUPNs). These networks replace all but the last hidden layer with a single layer of polynomials with learnable coefficients, leveraging the strengths of DNNs and polynomials to achieve sufficient expressivity with far fewer parameters. We prove that SUPNs converge at the same rate as the best polynomial approximation of the same degree, and we derive explicit formulas for quasi-optimal SUPN parameters. We complement theory with an extensive suite of numerical experiments involving SUPNs, DNNs, KANs, and polynomial projection in one, two, and ten dimensions, consisting of over 13,000 trained models. On the target functions we numerically studied, for a given number of trainable parameters, the approximation error and variability are often lower for SUPNs than for DNNs and KANs by an order of magnitude. In our examples, SUPNs even outperform polynomial projection on non-smooth functions.

函数逼近浅层网络多项式网络低参数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。