arXiv:2502.11927cs.LG2025-02被引 2

提出持续学习应突破分类任务局限,拓展至更复杂场景。

Continual Learning Should Move Beyond Incremental Classification

  • 分析多目标分类等实际场景中现有方法的失效原因
  • 指出持续学习需解决连续性、度量空间与目标函数三大挑战
  • 建议引入分布过程与生成目标,推动理论与应用发展

持续学习(CL)旨在动态环境中积累知识。当前研究多聚焦于增量分类任务,即模型在学习新类别时保留旧知识。本文指出,这种局限阻碍了理论发展与实际应用。通过分析多目标分类、受限输出空间的机器人、连续任务领域及高级概念记忆等具体案例,揭示现有方法在标准分类之外常失效。识别出三个根本挑战:(C1) 学习问题中的连续性本质;(C2) 选择合适的度量空间与相似性度量;(C3) 分类以外的学习目标。针对每项挑战提出建议,包括通过分布过程形式化时间动态、构建连续任务空间的合理方法,以及融入密度估计与生成目标。本立场论文旨在拓宽CL研究范畴,强化其理论基础,提升对真实问题的适用性。

原文摘要 · Abstract (English)

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new categories while retaining knowledge of previously learned ones. Here, we argue that maintaining such a focus limits both theoretical development and practical applicability of CL methods. Through a detailed analysis of concrete examples - including multi-target classification, robotics with constrained output spaces, learning in continuous task domains, and higher-level concept memorization - we demonstrate how current CL approaches often fail when applied beyond standard classification. We identify three fundamental challenges: (C1) the nature of continuity in learning problems, (C2) the choice of appropriate spaces and metrics for measuring similarity, and (C3) the role of learning objectives beyond classification. For each challenge, we provide specific recommendations to help move the field forward, including formalizing temporal dynamics through distribution processes, developing principled approaches for continuous task spaces, and incorporating density estimation and generative objectives. In so doing, this position paper aims to broaden the scope of CL research while strengthening its theoretical foundations, making it more applicable to real-world problems.

持续学习理论挑战生成目标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。