arXiv:2603.14272cs.LG2026-03

用函数空间统一解释有监督与无监督学习的本质差异。

Learning in Function Spaces: An Unified Functional Analytic View of Supervised and Unsupervised Learning

  • 以数据分布诱导的算子构建函数基,统一建模各类学习任务。
  • 有监督学依赖标签定义目标函数,无监督学依赖数据结构约束。
  • 适合理解算法背后的数学原理,尤其对理论研究者有价值。

许多机器学习算法可被看作是在数据分布上估计函数的过程。本文提出一个概念框架,将广泛的机器学习问题表述为在由数据分布诱导的函数空间上的变分优化。数据分布定义了捕捉数据结构性质(如相似性关系或统计依赖性)的算子。学习算法可视为在这些算子决定的基下估计函数。该视角统一了多种学习范式:有监督学习的目标泛函基于标注数据,通常对应最小化预测风险;无监督学习则依赖输入分布的结构性质,目标基于相似性或平滑性约束。从这一观点看,学习范式的区别主要源于所优化函数的选择,而非底层函数空间。我们通过与核方法、谱聚类和流形学习的联系说明此框架,强调数据分布诱导的算子自然定义了学习算法使用的函数表示。本工作不提出新算法,而是提供一个阐明函数空间与算子在现代机器学习中作用的概念框架。

原文摘要 · Abstract (English)

Many machine learning algorithms can be interpreted as procedures for estimating functions defined on the data distribution. In this paper we present a conceptual framework that formulates a wide range of learning problems as variational optimization over function spaces induced by the data distribution. Within this framework the data distribution defines operators that capture structural properties of the data, such as similarity relations or statistical dependencies. Learning algorithms can then be viewed as estimating functions expressed in bases determined by these operators. This perspective provides a unified way to interpret several learning paradigms. In supervised learning the objective functional is defined using labeled data and typically corresponds to minimizing prediction risk, whereas unsupervised learning relies on structural properties of the input distribution and leads to objectives based on similarity or smoothness constraints. From this viewpoint, the distinction between learning paradigms arises primarily from the choice of the functional being optimized rather than from the underlying function space. We illustrate this framework by discussing connections with kernel methods, spectral clustering, and manifold learning, highlighting how operators induced by data distributions naturally define function representations used by learning algorithms. The goal of this work is not to introduce a new algorithm but to provide a conceptual framework that clarifies the role of function spaces and operators in modern machine learning.

函数空间学习范式理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。