解决组合零样本学习中属性与物体关系复杂、长尾分布难题
Hybrid Discriminative Attribute-Object Embedding Network for Compositional Zero-Shot Learning
- 通过属性驱动数据合成扩充训练样本多样性
- 在三个基准数据集上实现更优的组合识别性能
- 适合研究零样本学习与细粒度特征建模的学者
组合零样本学习(CZSL)通过已知属性-物体配对识别新组合。然而,该任务的主要挑战在于属性与物体视觉表示之间的复杂交互,导致图像差异显著;同时真实世界中的长尾标签分布使识别更加困难。为此,本文提出一种新方法——混合判别式属性-物体嵌入网络(HDA-OE)。为增加训练数据变异性,HDA-OE引入属性驱动数据合成(ADDS)模块,通过组合同一物体的多个属性生成新样本,拓展属性空间,促使模型学习并区分属性间细微差异。为进一步提升模型判别能力,HDA-OE设计子类驱动判别嵌入(SDDE)模块,以细粒度方式嵌入子类信息,增强编码对属性与物体视觉特征复杂依赖关系的捕捉能力。所提模型在三个基准数据集上进行了评估,结果验证了其有效性和可靠性。
原文摘要 · Abstract (English)
Compositional Zero-Shot Learning (CZSL) recognizes new combinations by learning from known attribute-object pairs. However, the main challenge of this task lies in the complex interactions between attributes and object visual representations, which lead to significant differences in images. In addition, the long-tail label distribution in the real world makes the recognition task more complicated. To address these problems, we propose a novel method, named Hybrid Discriminative Attribute-Object Embedding (HDA-OE) network. To increase the variability of training data, HDA-OE introduces an attribute-driven data synthesis (ADDS) module. ADDS generates new samples with diverse attribute labels by combining multiple attributes of the same object. By expanding the attribute space in the dataset, the model is encouraged to learn and distinguish subtle differences between attributes. To further improve the discriminative ability of the model, HDA-OE introduces the subclass-driven discriminative embedding (SDDE) module, which enhances the subclass discriminative ability of the encoding by embedding subclass information in a fine-grained manner, helping to capture the complex dependencies between attributes and object visual features. The proposed model has been evaluated on three benchmark datasets, and the results verify its effectiveness and reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。