arXiv:2512.18471cs.LGq-bio.NC2025-12被引 1

用递归收缩机制解决持续学习中的表征干扰问题

The Urysohn Ladder: Recursive Metric Contraction for Scalable Continual Learning

  • 构建层次化商映射,递归压缩有效度量邻域为紧凑表征
  • 覆盖数恒定在O(1),实现无限序列学习的容量可控
  • 适合需要长期稳定学习的AI系统,如自动驾驶

持续学习系统面临根本性几何障碍:固定容量流形上经验积累导致覆盖数随时间线性增长,最终引发表征重叠与灾难性干扰。现有方法通过扩张——如核函数、过参数化或回放投影到高维空间——来应对。我们主张相反策略:收缩。提出‘乌里索恩阶梯’(Urysohn Ladder),一种层次化商映射结构,递归将验证过的度量邻域收缩为紧凑标记,将无界环境空间搜索转化为低维内在骨架上的有界导航。每个收缩标记如同捷径——极端度量收缩区域,连接遥远经验,类似表征流形中的虫洞。理论证明四点:可分性(度量收缩使非线性纠缠结构在每层商空间中线性可分且传播一致)、容量有界(每层覆盖数保持O(1),与数据流长度无关)、稳定性(奇偶分区流/骨架子空间支持无限可塑性而不产生灾难性干扰)、可扩展性(推理成本随商距离增长,而非环境距离)。通过预训练模型与真实数据集验证各结论,并展示通过骨架摊销实现可扩展持续学习的潜力。

原文摘要 · Abstract (English)

Continual learning systems face a fundamental geometric obstacle: as experience accumulates on a fixed-capacity manifold, covering numbers grow linearly with time, eventually forcing representational overlap and catastrophic interference. Prevailing approaches attack this problem by \emph{expansion} - projecting into higher-dimensional spaces via kernels, overparameterization, or replay. We argue the solution is the opposite: \emph{contraction}. We formalize abstraction as the \textbf{Urysohn Ladder}, a hierarchy of quotient maps that recursively collapse validated metric neighborhoods into compact tokens, converting unbounded ambient-space search into bounded navigation on a low-dimensional intrinsic scaffold. Geometrically, each collapsed token acts as a shortcut - a region of extreme metric contraction that bridges distant experiences, much like a wormhole in the representational manifold. We establish four results that collectively guarantee \emph{separability} (metric contraction renders nonlinearly entangled structure linearly separable at each quotient level, and this separability propagates faithfully through the entire hierarchy), \emph{bounded capacity} (covering numbers remain $O(1)$ per quotient level, independent of stream length), \emph{stability} (parity-partitioned flow/scaffold subspaces enable unbounded plasticity without catastrophic interference), and \emph{scalability} (inference cost scales with quotient distance, not ambient distance). We validate each claim empirically with pretrained models and real-world datasets. Moreover, we demonstrate the potential of Urysohn Ladder for scalable continual learning via scaffold amortization.

持续学习几何学习表征压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。