arXiv:2605.11652stat.MLcs.LG2026-05

证明稀疏贝叶斯KAN在各向异性Besov空间中逼近近最优后验收缩率。

Posterior Contraction Rates for Sparse Kolmogorov-Arnold Networks in Anisotropic Besov Spaces

  • 采用刺棒型稀疏先验,通过宽度与样条网格控制复杂度。
  • 后验收缩率接近最优,且对未知各向异性光滑性自适应。
  • 适用于高维函数建模,避免维度灾难,适合理论研究者。

我们研究了在各向异性Besov空间中稀疏贝叶斯Kolmogorov-Arnold网络(KANs)的后验收缩率,从贝叶斯视角为KANs提供统计基础。结果显示,配备刺棒型稀疏先验的稀疏贝叶斯KANs达到近最小最大后验收缩率,其收缩速率依赖于底层函数的内在各向异性光滑性。通过在单一模型尺寸参数上设置超先验,后验可自适应未知的各向异性光滑性,仍保持对应的近最小最大速率。相较于标准稀疏MLP模型,本方法可固定网络深度:由于可学习样条边函数的灵活性,所需逼近复杂度由网络宽度、样条网格范围与大小及参数稀疏性控制。分析发展了针对稀疏样条边结构的理论工具,包括贝叶斯KAN的逼近与复杂度界。进一步拓展至组合Besov空间,发现收缩率取决于逐层光滑性与组合结构的有效维度,从而有效避免维度灾难。整体成果推进了贝叶斯神经网络的理论理解,并为KANs提供了严格的统计基础。

原文摘要 · Abstract (English)

We study posterior contraction rates for sparse Bayesian Kolmogorov-Arnold networks (KANs) over anisotropic Besov spaces, providing a statistical foundation of KANs from a Bayesian point of view. We show that sparse Bayesian KANs equipped with spike-and-slab-type sparsity priors attain the near-minimax posterior contraction. In particular, the contraction rate depends on the intrinsic anisotropic smoothness of the underlying function. Moreover, by placing a hyperprior on a single model-size parameter, the resulting posterior adapts to unknown anisotropic smoothness and still achieves the corresponding near-minimax rate. A distinctive feature of our results, compared with those for standard sparse MLP-based models, is that the KAN depth can be kept fixed: owing to the flexibility of learnable spline edge functions, the required approximation complexity is controlled through the network width, spline-grid range and size, and parameter sparsity. Our analysis develops theoretical tools tailored to sparse spline-edge architectures, including approximation and complexity bounds for Bayesian KANs. We then extend to compositional Besov spaces and show that the contraction rates depend on layerwise smoothness and effective dimension of the underlying compositional structure, thereby effectively avoiding the curse of dimensionality. Together, the developed tools and findings advance the theoretical understanding of Bayesian neural networks and provide rigorous statistical foundations for KANs.

贝叶斯神经网络KAN各向异性收敛率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。