arXiv:2501.05635cs.LG2025-01KDD被引 8

通过集合函数与最优传输提升无监督图少样本学习性能

Enhancing Unsupervised Graph Few-shot Learning via Set Functions and Optimal Transport

  • 用集合函数提取无监督的集合级特征
  • 通过最优传输对齐支持集与查询集分布,缓解分布偏移
  • 无需大量标注数据,适合真实场景少样本学习

图少样本学习因其在少量标注数据下快速适应下游任务的能力而受到广泛关注。尽管现有模型表现优异,但仍存在三大局限:一、元训练阶段仅关注任务内实例级特征,忽略对类别区分至关重要的集合级特征;二、直接将查询集用于由少量标签的支持集训练的分类器,忽视两者间的分布偏移;三、通常需依赖大量基础类标注数据以提取可迁移知识,这在现实场景中难以实现。为此,我们提出新模型STAR,利用集合函数和最优传输机制,实现无监督图少样本学习的增强。STAR通过表达性强的集合函数无监督地获取集合级特征,并运用最优传输原理对齐支持集与查询集分布,减轻分布偏移影响。理论分析表明,该方法能捕捉更多任务相关特征,提升泛化能力。实验证明,STAR在多个数据集上均具显著有效性。

原文摘要 · Abstract (English)

Graph few-shot learning has garnered significant attention for its ability to rapidly adapt to downstream tasks with limited labeled data, sparking considerable interest among researchers. Recent advancements in graph few-shot learning models have exhibited superior performance across diverse applications. Despite their successes, several limitations still exist. First, existing models in the meta-training phase predominantly focus on instance-level features within tasks, neglecting crucial set-level features essential for distinguishing between different categories. Second, these models often utilize query sets directly on classifiers trained with support sets containing only a few labeled examples, overlooking potential distribution shifts between these sets and leading to suboptimal performance. Finally, previous models typically require necessitate abundant labeled data from base classes to extract transferable knowledge, which is typically infeasible in real-world scenarios. To address these issues, we propose a novel model named STAR, which leverages Set funcTions and optimAl tRansport for enhancing unsupervised graph few-shot learning. Specifically, STAR utilizes expressive set functions to obtain set-level features in an unsupervised manner and employs optimal transport principles to align the distributions of support and query sets, thereby mitigating distribution shift effects. Theoretical analysis demonstrates that STAR can capture more task-relevant information and enhance generalization capabilities. Empirically, extensive experiments across multiple datasets validate the effectiveness of STAR. Our code can be found here.

图神经网络少样本学习无监督学习最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。