arXiv:2502.20124cs.LGcs.AI2025-02被引 3

提出HoliTrans框架,实现已知与未知知识协同迁移。

Exploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfer

  • 设计非线性随机投影与分布感知原型,构建可动态更新的表征空间。
  • 在多种场景下超越22个基线模型,显著提升开放世界持续学习性能。
  • 适合研究开放世界学习、持续学习及未知样本检测的学者与工程师。

开放世界持续学习(OWCL)要求模型在不遗忘的前提下增量学习新知识,并在开放世界假设下识别未知样本。现有方法常将未知样本检测与持续学习分开处理,且主要关注已知样本的知识迁移,忽视了未知样本的潜在价值。本文定义了四种典型的OWCL场景,并通过系统实验揭示未知检测与已知分类之间存在显著交互关系,挑战了二者正交的传统假设。基于此,我们提出全新框架HoliTrans(全谱已知-未知知识迁移),融合非线性随机投影(NRP)以生成更易线性分离的嵌入空间,以及分布感知原型(DAPs)构建自适应知识空间。HoliTrans能同时支持已知与未知样本的知识迁移,并在学习过程中动态更新未知样本表示。大量实验表明,该方法在多个OWCL场景中优于22个先进基线,有效弥合理论与实践差距,为开放世界学习提供稳健可扩展的新范式。

原文摘要 · Abstract (English)

Open-World Continual Learning (OWCL) is a challenging paradigm where models must incrementally learn new knowledge without forgetting while operating under an open-world assumption. This requires handling incomplete training data and recognizing unknown samples during inference. However, existing OWCL methods often treat open detection and continual learning as separate tasks, limiting their ability to integrate open-set detection and incremental classification in OWCL. Moreover, current approaches primarily focus on transferring knowledge from known samples, neglecting the insights derived from unknown/open samples. To address these limitations, we formalize four distinct OWCL scenarios and conduct comprehensive empirical experiments to explore potential challenges in OWCL. Our findings reveal a significant interplay between the open detection of unknowns and incremental classification of knowns, challenging a widely held assumption that unknown detection and known classification are orthogonal processes. Building on our insights, we propose \textbf{HoliTrans} (Holistic Knowns-Unknowns Knowledge Transfer), a novel OWCL framework that integrates nonlinear random projection (NRP) to create a more linearly separable embedding space and distribution-aware prototypes (DAPs) to construct an adaptive knowledge space. Particularly, our HoliTrans effectively supports knowledge transfer for both known and unknown samples while dynamically updating representations of open samples during OWCL. Extensive experiments across various OWCL scenarios demonstrate that HoliTrans outperforms 22 competitive baselines, bridging the gap between OWCL theory and practice and providing a robust, scalable framework for advancing open-world learning paradigms.

持续学习开放世界知识迁移未知样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。