arXiv:2602.07141cs.LGmath.FA2026-02

提出新框架,让神经网络也能用核方法学习。

Featured Reproducing Kernel Banach Spaces for Learning and Neural Networks

  • 基于特征再生核巴拿赫空间,扩展核学习到非希尔伯特空间。
  • 证明了固定架构神经网络可视为特殊巴拿赫空间实例。
  • 为核方法与神经网络的统一提供了函数空间视角。

再生核希尔伯特空间是核学习的基础框架,其正则化与插值问题可通过经典表示定理得到有限维解。然而,许多现代学习模型——包括具有非二次范数的固定架构神经网络——自然产生非希尔伯特几何,超出该框架。在巴拿赫空间中,点评价泛函的连续性不足以保证特征表示或核学习形式。本文发展了一种基于特征再生核巴拿赫空间的功能分析框架,识别出在希尔伯特之外仍能恢复特征映射、核构造和表示型结果的精确结构条件。在此框架下,监督学习被表述为最小范数插值或正则化问题,并建立了存在性结果与条件表示定理。进一步将理论扩展至向量值特征再生核巴拿赫空间,证明固定架构神经网络自然诱导此类空间的特例。该框架统一了核方法与神经网络的函数空间视角,阐明了核学习原则何时可超越再生核希尔伯特空间。

原文摘要 · Abstract (English)

Reproducing kernel Hilbert spaces provide a foundational framework for kernel-based learning, where regularization and interpolation problems admit finite-dimensional solutions through classical representer theorems. Many modern learning models, however -- including fixed-architecture neural networks equipped with non-quadratic norms -- naturally give rise to non-Hilbertian geometries that fall outside this setting. In Banach spaces, continuity of point-evaluation functionals alone is insufficient to guarantee feature representations or kernel-based learning formulations. In this work, we develop a functional-analytic framework for learning in Banach spaces based on the notion of featured reproducing kernel Banach spaces. We identify the precise structural conditions under which feature maps, kernel constructions, and representer-type results can be recovered beyond the Hilbertian regime. Within this framework, supervised learning is formulated as a minimal-norm interpolation or regularization problem, and existence results together with conditional representer theorems are established. We further extend the theory to vector-valued featured reproducing kernel Banach spaces and show that fixed-architecture neural networks naturally induce special instances of such spaces. This provides a unified function-space perspective on kernel methods and neural networks and clarifies when kernel-based learning principles extend beyond reproducing kernel Hilbert spaces.

核方法神经网络巴拿赫空间函数空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。