arXiv:2511.16378cs.CV2025-11被引 1

通过多空间解耦与门控交叉注意力,提升零样本组合识别能力

CAMS: Towards Compositional Zero-Shot Learning via Gated Cross-Attention and Multi-Space Disentanglement

  • 用门控交叉注意力提取图像细粒度语义特征
  • 在多维空间中解耦属性与物体语义,提升未见组合泛化能力
  • 在三个主流数据集上达到顶尖性能,适合零样本学习研究者

组合零样本学习(CZSL)旨在从已见的属性-物体组合中学习概念,并识别未见过的组合。现有基于CLIP的方法主要依赖图像编码器获得的全局语义表示来解耦属性与物体,但该表示容量有限,难以实现完全解耦。为此,本文提出CAMS,通过从视觉特征中提取语义特征,并在多维空间中进行语义解耦,以增强对未见属性-物体组合的泛化能力。具体而言,CAMS设计了门控交叉注意力机制,利用一组隐单元从CLIP的高层图像编码块中捕捉细粒度语义特征,同时自适应抑制背景及其他无关信息;随后执行多空间解耦,实现属性与物体语义的分离。在MIT-States、UT-Zappos和C-GQA三个主流基准上的实验表明,CAMS在封闭世界和开放世界设置下均达到当前最优性能。代码已公开于https://github.com/ybyangjing/CAMS。

原文摘要 · Abstract (English)

Compositional zero-shot learning (CZSL) aims to learn the concepts of attributes and objects in seen compositions and to recognize their unseen compositions. Most Contrastive Language-Image Pre-training (CLIP)-based CZSL methods focus on disentangling attributes and objects by leveraging the global semantic representation obtained from the image encoder. However, this representation has limited representational capacity and do not allow for complete disentanglement of the two. To this end, we propose CAMS, which aims to extract semantic features from visual features and perform semantic disentanglement in multidimensional spaces, thereby improving generalization over unseen attribute-object compositions. Specifically, CAMS designs a Gated Cross-Attention that captures fine-grained semantic features from the high-level image encoding blocks of CLIP through a set of latent units, while adaptively suppressing background and other irrelevant information. Subsequently, it conducts Multi-Space Disentanglement to achieve disentanglement of attribute and object semantics. Experiments on three popular benchmarks (MIT-States, UT-Zappos, and C-GQA) demonstrate that CAMS achieves state-of-the-art performance in both closed-world and open-world settings. The code is available at https://github.com/ybyangjing/CAMS.

零样本学习语义解耦CLIP组合识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。