通过分层筛选邻居优化对比学习,提升文本分类精度
Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification
- 构建多关系图并分开展示,增强语义连接
- 提出邻居分层筛选损失,减少错误负样本
- 在多个数据集上表现优异,适合半监督文本任务
图对比学习在文本分类中因自监督节点表示学习能力突出而取得成功。然而,显式图增强可能导致对比视图中语义丢失。现有方法常忽略边特征及节点特征重要性的差异,且对比损失易产生误判负样本。为此,本文提出一种基于邻居分层筛选的对比多图学习方法(ConNHS)。首先利用核心特征构建多关系文本图,增强文本间语义关联,并通过图分离提供多样化的对比视图,最大限度保留图信息,减少数据失真。随后,分别执行关系感知传播与跨图注意力传播,有效利用节点间及边特征的异质相关性,实现多图信息融合。进一步提出邻居分层筛选损失(NHS),依据同质性假设,屏蔽锚点及其一阶邻域作为负样本,并排除高阶相似邻居,从而显著降低误判负样本率,防止相似样本在嵌入空间中距离扩大。在ThuCNews、SogouNews、20 Newsgroups和Ohsumed数据集上的实验结果分别为95.86%、97.52%、87.43%和70.65%,验证了该方法在半监督文本分类中的竞争力。
原文摘要 · Abstract (English)
Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of semantics in the contrastive views. Secondly, existing methods tend to overlook edge features and the varying significance of node features during multi-graph learning. Moreover, the contrastive loss suffer from false negatives. To address these limitations, we propose a novel method of contrastive multi-graph learning with neighbor hierarchical sifting for semi-supervised text classification, namely ConNHS. Specifically, we exploit core features to form a multi-relational text graph, enhancing semantic connections among texts. By separating text graphs, we provide diverse views for contrastive learning. Our approach ensures optimal preservation of the graph information, minimizing data loss and distortion. Then, we separately execute relation-aware propagation and cross-graph attention propagation, which effectively leverages the varying correlations between nodes and edge features while harmonising the information fusion across graphs. Subsequently, we present the neighbor hierarchical sifting loss (NHS) to refine the negative selection. For one thing, following the homophily assumption, NHS masks first-order neighbors of the anchor and positives from being negatives. For another, NHS excludes the high-order neighbors analogous to the anchor based on their similarities. Consequently, it effectively reduces the occurrence of false negatives, preventing the expansion of the distance between similar samples in the embedding space. Our experiments on ThuCNews, SogouNews, 20 Newsgroups, and Ohsumed datasets achieved 95.86\%, 97.52\%, 87.43\%, and 70.65\%, which demonstrates competitive results in semi-supervised text classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。