用动态属性评分减少生成数据量,实现更高效的零样本学习。
Few-Shot Inspired Generative Zero-Shot Learning
- 基于模型优化动态重评类别属性,模拟实例级变化
- 仅用少量合成特征即达领先性能,显著降低计算开销
- 适合资源受限场景下的零样本分类任务
生成式零样本学习(ZSL)通常依赖预定义语义属性合成视觉特征,再训练全监督分类器。但此类方法需大量计算资源和合成数据,违背原始ZSL假设。本文提出FSIGenZ框架,受少样本启发,减少对大规模特征合成的依赖。关键洞察是:类别属性在实例层面存在可变性(部分缺失或不完整),而传统方法将其视为统一存在。为此,我们引入模型特定属性评分(MSAS),基于模型优化动态调整属性得分,以近似实例级变化,无需访问未见数据。进一步,基于调整后的属性得分估计群体级原型,作为每个未见类别的代表性合成特征。为缓解由此导致的数据不平衡问题,我们在使用这些原型训练语义感知对比分类器(SCC)时引入双重目的语义正则化(DPSR)。在SUN、AwA2和CUB基准上的实验表明,FSIGenZ仅用极少合成特征即可达到竞争性表现。
原文摘要 · Abstract (English)
Generative zero-shot learning (ZSL) methods typically synthesize visual features for unseen classes using predefined semantic attributes, followed by training a fully supervised classification model. While effective, these methods require substantial computational resources and extensive synthetic data, thereby relaxing the original ZSL assumptions. In this paper, we propose FSIGenZ, a few-shot-inspired generative ZSL framework that reduces reliance on large-scale feature synthesis. Our key insight is that class-level attributes exhibit instance-level variability, i.e., some attributes may be absent or partially visible, yet conventional ZSL methods treat them as uniformly present. To address this, we introduce Model-Specific Attribute Scoring (MSAS), which dynamically re-scores class attributes based on model-specific optimization to approximate instance-level variability without access to unseen data. We further estimate group-level prototypes as clusters of instances based on MSAS-adjusted attribute scores, which serve as representative synthetic features for each unseen class. To mitigate the resulting data imbalance, we introduce a Dual-Purpose Semantic Regularization (DPSR) strategy while training a semantic-aware contrastive classifier (SCC) using these prototypes. Experiments on SUN, AwA2, and CUB benchmarks demonstrate that FSIGenZ achieves competitive performance using far fewer synthetic features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。