用动态原型引导学习,提升零样本分类的准确率。
Prototype-Guided Curriculum Learning for Zero-Shot Learning
- 按图像与语义原型相似度排序样本,逐步学习以减少偏差。
- 在AWA2、SUN、CUB上性能超越现有方法,最高提升3.2%。
- 适合做零样本识别且关注语义建模精度的研究者。
在零样本学习(ZSL)中,基于嵌入的方法通过将已见类图像映射到类别级语义原型(如属性)来实现知识迁移。然而,这些语义原型为人工定义,可能引入噪声监督:(i) 实例级不匹配——视角、遮挡和标注偏差导致个体样本与原型不一致;(ii) 类别级不精确——人工原型未必真实反映类别语义。为此,本文提出原型引导课程学习框架(CLZSL),包含两个模块:原型引导课程学习(PCL)模块根据图像视觉映射与原型的余弦相似度优先学习高匹配样本,逐步过渡到低匹配样本,缓解实例级不匹配;原型更新(PUP)模块利用实例学习的视觉映射动态调整类别级原型,降低类别级不精确性。在标准数据集AWA2、SUN、CUB上的实验验证了该方法的有效性。
原文摘要 · Abstract (English)
In Zero-Shot Learning (ZSL), embedding-based methods enable knowledge transfer from seen to unseen classes by learning a visual-semantic mapping from seen-class images to class-level semantic prototypes (e.g., attributes). However, these semantic prototypes are manually defined and may introduce noisy supervision for two main reasons: (i) instance-level mismatch: variations in perspective, occlusion, and annotation bias will cause discrepancies between individual sample and the class-level semantic prototypes; and (ii) class-level imprecision: the manually defined semantic prototypes may not accurately reflect the true semantics of the class. Consequently, the visual-semantic mapping will be misled, reducing the effectiveness of knowledge transfer to unseen classes. In this work, we propose a prototype-guided curriculum learning framework (dubbed as CLZSL), which mitigates instance-level mismatches through a Prototype-Guided Curriculum Learning (PCL) module and addresses class-level imprecision via a Prototype Update (PUP) module. Specifically, the PCL module prioritizes samples with high cosine similarity between their visual mappings and the class-level semantic prototypes, and progressively advances to less-aligned samples, thereby reducing the interference of instance-level mismatches to achieve accurate visual-semantic mapping. Besides, the PUP module dynamically updates the class-level semantic prototypes by leveraging the visual mappings learned from instances, thereby reducing class-level imprecision and further improving the visual-semantic mapping. Experiments were conducted on standard benchmark datasets-AWA2, SUN, and CUB-to verify the effectiveness of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。