arXiv:2512.12219cs.CV2025-12

提出属性解耦表征,让模型更好区分细粒度类别间的细微差异。

Fine-Grained Zero-Shot Learning with Attribute-Centric Representations

  • 通过双专家混合机制,分离图像块与属性特征,避免属性混淆。
  • 在CUB、AwA2、SUN数据集上达到零样本学习新高。
  • 适合需要精准识别细粒度类别的视觉任务研究者。

识别未见的细粒度类别需要模型能区分细微的视觉差异。传统方法通过将已见类别的视觉属性关系迁移至未见类别来实现,但核心挑战在于属性纠缠:现有模型常将颜色、形状、纹理等不同属性混入单一视觉嵌入中,导致干扰并掩盖关键差异。以往的后处理方案因作用于已混淆的表征,效果有限。本文提出零样本学习框架,通过在表征学习阶段强制属性解耦,构建属性中心表征(ACR)。ACR由两个混合专家组件实现:图像块混合专家(MoPE)与属性混合专家(MoAE)。MoPE采用双层路由机制,将图像块动态分配给特定专家,确保同属性家族的信息由专用专家处理;最终,MoAE头将专家优化后的特征投影为稀疏且部件感知的属性图,提升零样本分类鲁棒性。在零样本学习基准数据集CUB、AwA2和SUN上,我们的ACR实现了持续领先的性能。

原文摘要 · Abstract (English)

Recognizing unseen fine-grained categories demands a model that can distinguish subtle visual differences. This is typically achieved by transferring visual-attribute relationships from seen classes to unseen classes. The core challenge is attribute entanglement, where conventional models collapse distinct attributes like color, shape, and texture into a single visual embedding. This causes interference that masks these critical distinctions. The post-hoc solutions of previous work are insufficient, as they operate on representations that are already mixed. We propose a zero-shot learning framework that learns AttributeCentric Representations (ACR) to tackle this problem by imposing attribute disentanglement during representation learning. ACR is achieved with two mixture-of-experts components, including Mixture of Patch Experts (MoPE) and Mixture of Attribute Experts (MoAE). First, MoPE is inserted into the transformer using a dual-level routing mechanism to conditionally dispatch image patches to specialized experts. This ensures coherent attribute families are processed by dedicated experts. Finally, the MoAE head projects these expert-refined features into sparse, partaware attribute maps for robust zero-shot classification. On zero-shot learning benchmark datasets CUB, AwA2, and SUN, our ACR achieves consistent state-of-the-art results.

零样本学习属性解耦细粒度识别视觉表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。