arXiv:2511.08163cs.CV2025-11

通过多粒度特征交互,提升零样本学习的识别性能

Multi-Granularity Mutual Refinement Network for Zero-Shot Learning

  • 设计多粒度特征提取模块,分离挖掘区域级判别特征
  • 跨粒度融合模块增强不同层级区域特征的内在关联
  • 在三个基准数据集上显著优于现有方法,适合零样本识别研究

零样本学习(ZSL)旨在通过已见类的语义知识迁移,识别未见类别。现有方法通常将全局视觉特征与语义信息(如属性)关联,或对齐局部区域特征与对应属性以增强视觉-语义交互。然而,这些方法常忽略局部区域特征间的内在交互,而该交互可进一步提升可迁移、显式的视觉特征获取。本文提出多粒度互优化网络(Mg-MRN),通过解耦的多粒度特征学习与跨粒度特征交互,优化判别性与可迁移的视觉特征。具体地,设计多粒度特征提取模块,通过解耦区域特征挖掘获取区域级判别特征;再设计跨粒度特征融合模块,强化不同粒度区域特征间的内在交互,通过整合相邻层次的区域表示,增强各粒度层级表征的判别能力,从而提升ZSL识别性能。在三个主流ZSL基准数据集上的大量实验表明,所提Mg-MRN方法具有优越性与竞争力。代码已开源:https://github.com/NingWang2049/Mg-MRN。

原文摘要 · Abstract (English)

Zero-shot learning (ZSL) aims to recognize unseen classes with zero samples by transferring semantic knowledge from seen classes. Current approaches typically correlate global visual features with semantic information (i.e., attributes) or align local visual region features with corresponding attributes to enhance visual-semantic interactions. Although effective, these methods often overlook the intrinsic interactions between local region features, which can further improve the acquisition of transferable and explicit visual features. In this paper, we propose a network named Multi-Granularity Mutual Refinement Network (Mg-MRN), which refine discriminative and transferable visual features by learning decoupled multi-granularity features and cross-granularity feature interactions. Specifically, we design a multi-granularity feature extraction module to learn region-level discriminative features through decoupled region feature mining. Then, a cross-granularity feature fusion module strengthens the inherent interactions between region features of varying granularities. This module enhances the discriminability of representations at each granularity level by integrating region representations from adjacent hierarchies, further improving ZSL recognition performance. Extensive experiments on three popular ZSL benchmark datasets demonstrate the superiority and competitiveness of our proposed Mg-MRN method. Our code is available at https://github.com/NingWang2049/Mg-MRN.

零样本学习多粒度特征视觉-语义对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。