arXiv:2501.03584cs.LG2025-01被引 1

解决短文本聚类中误分同类样本的问题,提升特征区分度。

Discriminative Representation learning via Attention-Enhanced Contrastive Learning for Short Text Clustering

  • 通过样本级注意力机制聚合跨样本特征,生成一致表征。
  • 利用判别性表征优化正样本构建,有效避免错误分离同类样本。
  • 适合需要高精度短文本聚类的场景,如社交媒体分析。

对比学习在短文本聚类中受到广泛关注,但存在将同类别样本误判为负样本并导致特征空间中错误分离(虚假负样本分离)的固有缺陷,阻碍了优质表征的生成。为生成更具判别性的表征以实现高效聚类,本文提出一种新方法——基于注意力增强对比学习的短文本聚类(AECL)。AECL包含伪标签生成模块和对比学习模块,两者均引入样本级注意力机制,捕捉样本间相似关系,并聚合跨样本特征以生成一致表征。前者利用更判别性的一致表征生成可靠监督信号辅助聚类,后者则通过探索相似关系与一致表征优化正样本构建,实现相似性引导的对比学习,有效缓解虚假负样本分离问题。实验结果表明,所提AECL优于现有先进方法。若论文被接收,将开源代码。

原文摘要 · Abstract (English)

Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the feature space (false negative separation), which hinders the generation of superior representations. To generate more discriminative representations for efficient clustering, we propose a novel short text clustering method, called Discriminative Representation learning via \textbf{A}ttention-\textbf{E}nhanced \textbf{C}ontrastive \textbf{L}earning for Short Text Clustering (\textbf{AECL}). The \textbf{AECL} consists of two modules which are the pseudo-label generation module and the contrastive learning module. Both modules build a sample-level attention mechanism to capture similarity relationships between samples and aggregate cross-sample features to generate consistent representations. Then, the former module uses the more discriminative consistent representation to produce reliable supervision information for assist clustering, while the latter module explores similarity relationships and consistent representations optimize the construction of positive samples to perform similarity-guided contrastive learning, effectively addressing the false negative separation issue. Experimental results demonstrate that the proposed \textbf{AECL} outperforms state-of-the-art methods. If the paper is accepted, we will open-source the code.

短文本聚类对比学习注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。