让快速学习系统不追求泛化,实现持续的零样本与少样本学习。
Active perception and disentangled representations allow continual, episodic zero and few-shot learning
- 快慢双系统并行:快系统专注快速适应,不追求泛化。
- 利用上下文偏差使慢系统将新刺激编码为已知类别,实现零样本学习。
- 适合需要持续学习、快速适应新任务的场景,如机器人交互。
泛化常被视为机器学习系统的核心能力,但并非所有组件都需泛化。传统泛化训练会在实体或类别边界产生纠缠表征,导致在持续学习或少样本学习中出现破坏性干扰。现有快速学习技术虽能避免干扰,却难以泛化。本文提出一种互补学习系统(CLS),其中快速学习模块放弃泛化,专注于持续的零样本与少样本学习。不同于多数依赖回放和巩固的事件记忆机制,该快系统作为并行推理单元运行。通过主动感知系统,快系统提供的上下文偏差促使慢系统以已有通用概念编码新刺激,从而实现零样本与少样本学习。该架构证明了快速情境推理与缓慢结构化泛化可共存,为鲁棒持续学习提供新路径。
原文摘要 · Abstract (English)
Generalization is often regarded as an essential property of machine learning systems. However, perhaps not every component of a system needs to generalize. Training models for generalization typically produces entangled representations at the boundaries of entities or classes, which can lead to destructive interference when rapid, high-magnitude updates are required for continual or few-shot learning. Techniques for fast learning with non-interfering representations exist, but they generally fail to generalize. Here, we describe a Complementary Learning System (CLS) in which the fast learner entirely foregoes generalization in exchange for continual zero-shot and few-shot learning. Unlike most CLS approaches, which use episodic memory primarily for replay and consolidation, our fast, disentangled learner operates as a parallel reasoning system. The fast learner can overcome observation variability and uncertainty by leveraging a conventional slow, statistical learner within an active perception system: A contextual bias provided by the fast learner induces the slow learner to encode novel stimuli in familiar, generalized terms, enabling zero-shot and few-shot learning. This architecture demonstrates that fast, context-driven reasoning can coexist with slow, structured generalization, providing a pathway for robust continual learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。