用双层超球嵌入提升组合零样本学习的泛化能力
$\text{H}^2$em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learning
- 构建超球空间中的分层嵌入,天然适配语义树状结构
- 在三个基准上实现闭世界与开世界新最佳性能
- 适合需要处理复杂语义层次的视觉认知任务
组合零样本学习(CZSL)旨在通过其基本元素(状态和对象)的训练集,识别未见过的状态-对象组合。现有方法常忽略丰富的层次结构,如基本元素间的语义层级(如苹果属于水果)和基本元素与组合间概念层级(如切片苹果)。尽管少数近期工作尝试在欧式空间中通过损失正则化建模这些层次,但其平坦几何导致体积呈多项式增长,难以匹配指数型结构,限制了泛化能力。本文提出H2em框架,采用超球几何学习分层嵌入,该空间天然适合低失真嵌入树状结构。为防止层级坍塌和细粒度区分不足,设计双重目标:双层蕴含损失利用超球蕴含锥强化预设层级;判别对齐损失结合难负样本挖掘,在测地线上拉大语义相似组合的距离。进一步提出超球跨模态注意力,实现超球空间内的实例感知跨模态融合。在三个基准上的大量消融实验表明,H2em在闭世界与开世界场景均达到新最优表现。代码将公开。
原文摘要 · Abstract (English)
Compositional zero-shot learning (CZSL) aims to recognize unseen state-object compositions by generalizing from a training set of their primitives (state and object). Current methods often overlook the rich hierarchical structures, such as the semantic hierarchy of primitives (e.g., apple fruit) and the conceptual hierarchy between primitives and compositions (e.g, sliced apple apple). A few recent efforts have shown effectiveness in modeling these hierarchies through loss regularization within Euclidean space. In this paper, we argue that they fail to scale to the large-scale taxonomies required for real-world CZSL: the space's polynomial volume growth in flat geometry cannot match the exponential structure, impairing generalization capacity. To this end, we propose H2em, a new framework that learns Hierarchical Hyperbolic EMbeddings for CZSL. H2em leverages the unique properties of hyperbolic geometry, a space naturally suited for embedding tree-like structures with low distortion. However, a naive hyperbolic mapping may suffer from hierarchical collapse and poor fine-grained discrimination. We further design two learning objectives to structure this space: a Dual-Hierarchical Entailment Loss that uses hyperbolic entailment cones to enforce the predefined hierarchies, and a Discriminative Alignment Loss with hard negative mining to establish a large geodesic distance between semantically similar compositions. Furthermore, we devise Hyperbolic Cross-Modal Attention to realize instance-aware cross-modal infusion within hyperbolic geometry. Extensive ablations on three benchmarks demonstrate that H2em establishes a new state-of-the-art in both closed-world and open-world scenarios. Our codes will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。