提出条件概率框架,精准建模属性与物体的依赖关系,提升零样本组合识别能力。
A Conditional Probability Framework for Compositional Zero-shot Learning

- 用条件概率分解组合概率,显式建模属性与物体的依赖关系。
- 在多个基准上实现最优性能,显著优于现有方法。
- 适合关注零样本学习、属性-物体关联建模的研究者。
组合零样本学习(CZSL)旨在通过利用已见组合的知识,识别未见过的已知物体与属性的组合。传统方法主要关注分离属性与物体,将其视为独立实体进行学习,但这一假设忽略了组合内部的语义约束和上下文依赖。例如,'条纹'自然适用于'斑马'或'衬衫',而不适用于'天空'或'水';同一属性在不同上下文中表现各异(如'年轻'在'幼树'与'幼犬'中含义不同)。因此,捕捉属性-物体的相互依赖性仍是CZSL中的核心挑战。本文提出条件概率框架(CPF),显式建模属性-物体依赖关系。将组合概率分解为物体出现概率与属性在该物体下的条件概率两部分。为增强物体特征学习,引入文本描述以突出语义相关图像区域;这些增强后的物体特征通过交叉注意力机制引导属性学习,实现更优的上下文对齐。通过联合优化物体概率与条件属性概率,模型有效捕捉组合依赖,泛化至未见组合表现优异。在多个CZSL基准上的实验验证了该方法的优越性。代码已公开。
原文摘要 · Abstract (English)
Compositional Zero-Shot Learning (CZSL) aims to recognize unseen combinations of known objects and attributes by leveraging knowledge from previously seen compositions. Traditional approaches primarily focus on disentangling attributes and objects, treating them as independent entities during learning. However, this assumption overlooks the semantic constraints and contextual dependencies inside a composition. For example, certain attributes naturally pair with specific objects (e.g., "striped" applies to "zebra" or "shirts" but not "sky" or "water"), while the same attribute can manifest differently depending on context (e.g., "young" in "young tree" vs. "young dog"). Thus, capturing attribute-object interdependence remains a fundamental yet long-ignored challenge in CZSL. In this paper, we adopt a Conditional Probability Framework (CPF) to explicitly model attribute-object dependencies. We decompose the probability of a composition into two components: the likelihood of an object and the conditional likelihood of its attribute. To enhance object feature learning, we incorporate textual descriptors to highlight semantically relevant image regions. These enhanced object features then guide attribute learning through a cross-attention mechanism, ensuring better contextual alignment. By jointly optimizing object likelihood and conditional attribute likelihood, our method effectively captures compositional dependencies and generalizes well to unseen compositions. Extensive experiments on multiple CZSL benchmarks demonstrate the superiority of our approach. Code is available at here.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。