arXiv:2508.15823cs.CLcs.LG2025-08中稿 · publication in IEE…被引 2

用语义嵌入提升文本聚类,准确率超85%。

SDEC: Semantic Deep Embedded Clustering

  • 融合Transformer嵌入与改进自编码器,保留语义关系
  • 在AG新闻数据集上达85.7%准确率,Yahoo!答案集创53.63%新高
  • 适合需要高精度无监督文本聚类的研究者

文本大数据具有高维性和语义复杂性,传统聚类方法如k-means或层次聚类常导致次优分组。本文提出语义深度嵌入聚类(SDEC),一种结合改进自编码器与基于Transformer的嵌入的无监督文本聚类框架。该方法通过在自编码器中联合使用均方误差(MSE)与余弦相似性损失(CSL),在数据重建过程中保持语义关系。此外,SDEC引入语义精炼阶段,利用Transformer嵌入的上下文丰富性,通过软聚类分配和分布损失进一步优化聚类层。在五个基准数据集(AG News、Yahoo! Answers、DBPedia、Reuters 2、Reuters 5)上的大量实验表明,SDEC不仅在AG News上达到85.7%的聚类准确率,还在Yahoo! Answers上创下53.63%的新基准,且在其他多样文本语料上表现稳健。结果凸显了SDEC在无监督文本聚类中对准确率与语义理解的显著提升。

原文摘要 · Abstract (English)

The high dimensional and semantically complex nature of textual Big data presents significant challenges for text clustering, which frequently lead to suboptimal groupings when using conventional techniques like k-means or hierarchical clustering. This work presents Semantic Deep Embedded Clustering (SDEC), an unsupervised text clustering framework that combines an improved autoencoder with transformer-based embeddings to overcome these challenges. This novel method preserves semantic relationships during data reconstruction by combining Mean Squared Error (MSE) and Cosine Similarity Loss (CSL) within an autoencoder. Furthermore, a semantic refinement stage that takes advantage of the contextual richness of transformer embeddings is used by SDEC to further improve a clustering layer with soft cluster assignments and distributional loss. The capabilities of SDEC are demonstrated by extensive testing on five benchmark datasets: AG News, Yahoo! Answers, DBPedia, Reuters 2, and Reuters 5. The framework not only outperformed existing methods with a clustering accuracy of 85.7% on AG News and set a new benchmark of 53.63% on Yahoo! Answers, but also showed robust performance across other diverse text corpora. These findings highlight the significant improvements in accuracy and semantic comprehension of text data provided by SDEC's advances in unsupervised text clustering.

文本聚类深度学习Transformer无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。