无需数据增强,用多图结构直接对比学习,提升短文本分类效果
A Simple Graph Contrastive Learning Framework for Short Text Classification
- 基于多个文本组件图生成多视图嵌入,不依赖数据增强
- 在多个数据集上超越大型语言模型表现
- 方法简洁高效,适合资源有限场景下的短文本分类
短文本分类因广泛存在和实际应用而备受关注。近年来,图学习与对比学习结合在应对语义稀疏和标注数据不足方面展现出良好前景。然而现有模型存在局限:依赖显式数据增强生成对比视图,导致语义扭曲和噪声;仅关注视图间内在一致性,忽略其他潜在视图中的判别信息。为此,我们提出简单图对比学习框架(SimSTC),通过在多个文本相关组件图上进行图学习,获取多视图文本嵌入,并直接对这些嵌入实施对比学习。该方法无需数据增强即可实现多视图对比学习优势。尽管结构简单,模型在多个数据集上性能优异,甚至超过大型语言模型。
原文摘要 · Abstract (English)
Short text classification has gained significant attention in the information age due to its prevalence and real-world applications. Recent advancements in graph learning combined with contrastive learning have shown promising results in addressing the challenges of semantic sparsity and limited labeled data in short text classification. However, existing models have certain limitations. They rely on explicit data augmentation techniques to generate contrastive views, resulting in semantic corruption and noise. Additionally, these models only focus on learning the intrinsic consistency between the generated views, neglecting valuable discriminative information from other potential views. To address these issues, we propose a Simple graph contrastive learning framework for Short Text Classification (SimSTC). Our approach involves performing graph learning on multiple text-related component graphs to obtain multi-view text embeddings. Subsequently, we directly apply contrastive learning on these embeddings. Notably, our method eliminates the need for data augmentation operations to generate contrastive views while still leveraging the benefits of multi-view contrastive learning. Despite its simplicity, our model achieves outstanding performance, surpassing large language models on various datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。