arXiv:2605.11710cs.LGcs.CV2026-05

分离表征与组合推理,提升持续少样本学习的泛化能力

Unlocking Compositional Generalization in Continual Few-Shot Learning

论文配图:Unlocking Compositional Generalization in Continual Few-Shot Learning
图 1 · 摘自论文原文
  • 训练时用全局语义优化槽位表征,保持对象级几何结构
  • 推理时动态组合槽位,实现对全新概念的零样本匹配
  • 适用于需要持续学习新类别的实际场景,如智能机器人

基于物体中心的表征在少样本学习中具有潜力:将场景分解为可跨概念匹配的独立对象单元。然而实践中,持续学习模型通常将场景压缩为全局嵌入,或使用部件级匹配目标导致表征过度依赖已见模式,难以泛化到真正新颖的概念。本文识别出这一结构性矛盾,提出一种严格解耦表征学习与组合推理的新范式。利用自监督视觉变换器(ViT)固有的分块级语义几何,框架采用双阶段策略:训练阶段,槽位表征仅优化整体类别身份,保留高度可泛化的对象级几何;推理阶段,冻结的槽位被动态组合以匹配新场景。实验证明,该范式兼具双重结构优势:冻结主干防止表征漂移,轻量级全局优化维持特征对新概念的迁移能力。在标准持续学习基准上,该方法实现了最先进的未见概念泛化性能和最小遗忘。

原文摘要 · Abstract (English)

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different concepts. In practice, this potential is rarely realized. Continual learners either collapse scenes into global embeddings, or train with part-level matching objectives that tie representations too closely to seen patterns, leaving them unable to generalize to truly novel concepts. In this paper, we identify this fundamental structural conflict and pioneer a new paradigm that strictly decouples representation learning from compositional inference. Leveraging the inherent patch-level semantic geometry of self-supervised Vision Transformers (ViTs), our framework employs a dual-phase strategy. During training, slot representations are optimized entirely toward holistic class identity, preserving highly generalizable, object-level geometries. At inference, preserved slots are dynamically composed to match novel scenes. We demonstrate that this paradigm offers dual structural benefits: The frozen backbone naturally prevents representation drift, while our lightweight, holistic optimization preserves the features' capacity for novel-concept transfer. Extensive experiments validate this approach, achieving state-of-the-art unseen-concept generalization and minimal forgetting across standard continual learning benchmarks.

少样本学习持续学习组合泛化视觉表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。