解决短文本聚类中伪标签不一致问题,提升聚类准确率
Beyond Looking Up, Try Looking Around: Harmonizing Global Structure and Local Consistency in Optimal Transport for Short Text Clustering

- 引入实例级注意力捕捉样本间语义关系,增强局部一致性
- 融合全局结构与局部一致性,生成更可靠的伪标签
- 适合需要高精度聚类的短文本任务,如社交媒体分析
基于最优传输(OT)的伪标签机制已成为提升短文本聚类性能的有效方法。现有OT方法在建模样本间语义一致性方面存在不足,可能导致语义相似的样本被分配不同伪标签,从而影响聚类质量。本文提出一种新型短文本聚类框架,弥补了现有OT方法对语义一致性的忽视,生成更可靠的伪标签以指导聚类。具体地,该方法首先设计实例级注意力机制,捕捉样本间的语义关系,并将其融入OT公式,使传输过程具备邻域语义感知能力。通过求解该优化问题,得到同时考虑样本间语义一致性和样本到聚类全局结构信息的可靠伪标签。这些伪标签作为监督信号,引导模型实现精准聚类。大量实验表明,所提方法优于当前最优方法。代码已公开:https://github.com/YZH0905/CAOT-STC。
原文摘要 · Abstract (English)
Pseudo-labeling based on Optimal Transport (OT) has become an effective mechanism for enhancing short text clustering. Existing OT methods are short in modeling semantic consistencies between samples, which may assign different pseudo-labels to semantically similar samples. These erroneous pseudo-labels can cause the model to produce inferior clusters. This paper proposes a novel short text clustering framework, which remedies the neglect of semantic consistency in existing OT methods, generating reliable pseudo-labels to facilitate clustering. Specifically, the proposed approach first designs an instance-level attention mechanism to capture semantic relationships between samples, which are then integrated into the OT formulation to endow the transport process with neighborhood semantic awareness. By solving the proposed OT formulation, reliable pseudo-labels are obtained that simultaneously account for sample-to-sample semantic consistency and sample-to-cluster global structure information. These pseudo-labels are then used as supervisory signals to guide the model to achieve accurate clustering. Extensive experiments demonstrate that the proposed approach outperforms state-of-the-art methods. The code is available at: \href{https://github.com/YZH0905/CAOT-STC}{https://github.com/YZH0905/CAOT-STC}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。