arXiv:2602.07974cs.LG2026-02被引 1

提出结构学习理论,用‘宽度’量化复杂环境下的学习难度。

Structural Learning Theory: A Metric-Topology Factorization Approach

  • 引入‘宽度’概念,衡量覆盖问题所需的最少低风险可收缩单元数。
  • 宽度决定学习成败:不足则存在不可消除的结构误差下限。
  • 提出可收缩相似性算子与度量弹弓法,助力持续学习中的结构发现与泛化。

在结构化、多场景或非平稳环境中学习面临两个独立挑战:一是‘度量’问题——一旦上下文确定,预测有多难?这属于统计学习理论(SLT)范畴;二是‘结构’问题——需要多少局部上下文?如何从数据中发现它们?本文发展了针对结构轴的结构学习理论(StrLT)。提出‘宽度’——覆盖学习问题所需的最小联合收缩且低风险单元数。宽度与VC维不可比较:任一可发散而另一保持有界。我们证明宽度引发‘相变’:若分配单元数 $K<w$,学习存在不可消除的结构性误差下限;若 $K\ge w$,问题退化为普通单元内统计学习。为估计宽度,引入任务自适应的‘可收缩相似性’(CS)算子,结合几何局部性与预测兼容性,其CS拉普拉斯算子通过谱分离揭示收缩盆地。进一步提出‘度量弹弓’,利用低维潜在收缩映射降低漏斗式学习成本。三者共同将学习分解为陷阱发现与漏斗泛化,对开放环境下持续与终身学习具有深远意义。

原文摘要 · Abstract (English)

Learning in structured, multi-context, or non-stationary environments involves two orthogonal difficulties. The first is \emph{metric}: once the correct context is known, how hard is prediction within it? This is the domain of Statistical Learning Theory (SLT). The second is \emph{structural}: how many local contexts are required, and how can they be discovered from data? This paper develops \emph{Structural Learning Theory} (StrLT) for the structural axis. We introduce \emph{width}, the minimum number of jointly contractive and low-risk cells needed to cover a learning problem. Width is incomparable with VC dimension: either can diverge while the other remains bounded. We show that width induces a \emph{phase transition}: if the allocated number of cells \(K<w\), learning suffers an irreducible structural error floor; if \(K\ge w\), the problem reduces to ordinary within-cell statistical learning. To estimate width, we introduce the \emph{contractive-similarity} (CS) operator, a task-adaptive graph kernel combining geometric locality with predictive compatibility. Its CS Laplacian exposes contractive basins through spectral separation. We further develop the \emph{metric slingshot}, which reuses low-dimensional latent contraction maps to reduce funnel-learning cost. Together, width, CS estimation, and the slingshot decompose learning into trap discovery and funnel generalization, with deep implications for continual and lifelong learning in an open-ended environment.

结构学习相变持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。