改进生成模型,让零样本学习更准。
Improved Feature Generating Framework for Transductive Zero-shot Learning
- 用伪条件对抗学习和变分嵌入回归,改进特征生成。
- 在多个基准上达到当前最好准确率,提升显著。
- 适合研究零样本学习与生成模型的学者。
特征生成对抗网络已成为零样本学习(ZSL)中生成未见类别高质量表示的强大模型。本文深入探讨了在横贯式零样本学习(TZSL)框架下未见类别先验的重要影响,发现即使轻微的先验偏差也会导致显著的准确率下降。我们的分析表明,这种低效性根本原因在于现有TZSL中使用了无条件的未见类别判别器——这一核心组件。我们进一步证明,除非生成器完美拟合特定类别分布,否则该组件的负面影响不可避免。基于这些发现,我们提出改进的特征生成框架I-VAEGAN,包含两项新组件:伪条件特征对抗(PFA)学习与变分嵌入回归(VER)。PFA通过精确语义回归预设预测语义作为伪条件,避免先验估计;VER利用重建预训练学习类别统计,实现更好语义回归。I-VAEGAN在多个基准和先验设置下均达到当前最优的TZSL准确率。代码将在录用后公开。
原文摘要 · Abstract (English)
Feature Generative Adversarial Networks have emerged as powerful generative models in producing high-quality representations of unseen classes within the scope of Zero-shot Learning (ZSL). This paper delves into the pivotal influence of unseen class priors within the framework of transductive ZSL (TZSL) and illuminates the finding that even a marginal prior bias can result in substantial accuracy declines. Our extensive analysis uncovers that this inefficacy fundamentally stems from the utilization of an unconditional unseen discriminator - a core component in existing TZSL. We further establish that the detrimental effects of this component are inevitable unless the generator perfectly fits class-specific distributions. Building on these insights, we introduce our Improved Feature Generation Framework, termed I-VAEGAN, which incorporates two novel components: Pseudo-conditional Feature Adversarial (PFA) learning and Variational Embedding Regression (VER). PFA circumvents the need for prior estimation by explicitly injecting the predicted semantics as pseudo conditions for unseen classes premised by precise semantic regression. Meanwhile, VER utilizes reconstructive pre-training to learn class statistics, obtaining better semantic regression. Our I-VAEGAN achieves state-of-the-art TZSL accuracy across various benchmarks and priors. Our code would be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。