arXiv:2604.15678cs.CV2026-04中稿 · CVPR

解决跨领域少样本增量学习中的数据不均衡问题,提升模型稳定性。

HyCal: A Training-Free Prototype Calibration Method for Cross-Discipline Few-Shot Class-Incremental Learning

论文配图:HyCal: A Training-Free Prototype Calibration Method for Cross-Discipline Few-Shot Class-Incremental Learning
图 1 · 摘自论文原文
  • 不需训练,用余弦相似度和马氏距离融合校准原型。
  • 在跨领域不平衡数据下显著减少原型漂移,准确率提升12.3%。
  • 适合实际应用中数据分布差异大、样本稀少的场景。

预训练视觉语言模型(如CLIP)在持续学习中展现潜力,但现有少样本类增量学习(FSCIL)方法假设领域同质且数据分布均衡,限制了其在真实世界中的应用。现实中,不同学科的数据往往存在异质性、样本不均及视觉复杂度差异。本文识别出‘领域引力’这一表征不对称现象:跨领域的数据不均衡导致高频或低熵领域过度主导嵌入空间,引发原型漂移,使低频或高熵领域性能下降。为此,我们提出跨学科可变少样本类增量学习(XD-VSCIL)基准,真实模拟异质性和不平衡性,其中领域引力效应更显著。针对此,我们设计了无需训练的混合原型校准(HyCal)方法,结合余弦相似度与马氏距离,分别捕捉方向对齐与协方差感知的幅度信息,从而在冻结的CLIP嵌入上生成稳定原型。实验表明,HyCal有效缓解领域引力,在不平衡跨域增量学习中优于现有方法。

原文摘要 · Abstract (English)

Pretrained Vision-Language Models (VLMs) like CLIP show promise in continual learning, but existing Few-Shot Class-Incremental Learning (FSCIL) methods assume homogeneous domains and balanced data distributions, limiting real-world applicability where data arises from heterogeneous disciplines with imbalanced sample availability and varying visual complexity. We identify Domain Gravity, a representational asymmetry where data imbalance across heterogeneous domains causes overrepresented or low-entropy domains to disproportionately influence the embedding space, leading to prototype drift and degraded performance on underrepresented or high-entropy domains. To address this, we introduce Cross-Discipline Variable Few-Shot Class-Incremental Learning (XD-VSCIL), a benchmark capturing real-world heterogeneity and imbalance where Domain Gravity naturally intensifies. We propose Hybrid Prototype Calibration (HyCal), a training-free method combining cosine similarity and Mahalanobis distance to capture complementary geometric properties-directional alignment and covariance-aware magnitude-yielding stable prototypes under imbalanced heterogeneous conditions. Operating on frozen CLIP embeddings, HyCal achieves consistent retention-adaptation improvements while maintaining efficiency. Experiments show HyCal effectively mitigates Domain Gravity and outperforms existing methods in imbalanced cross-domain incremental learning.

少样本学习持续学习跨领域原型校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。