arXiv:2606.28328cs.IRcs.LG2026-06

构建可定制的文本聚类数据生成框架,解决评估难题。

TextClusterLab: An Integrated Framework for Reliable Text Clustering Studies

论文配图:TextClusterLab: An Integrated Framework for Reliable Text Clustering Studies
图 1 · 摘自论文原文
  • 用大模型生成带可控属性的合成文本数据
  • 支持不平衡、紧凑性等10+聚类特性设置
  • 适合算法开发者与评测研究者使用

近年来,文本聚类在意图发现、主题挖掘和推荐系统中发挥重要作用。然而,由于真实文本数据语义边界模糊、嵌入维度高且聚类结构不一致,评估聚类算法仍具挑战性。现有聚类数据生成工具针对数值型数据设计,难以满足文本特异性评估需求。本文提出TextClusterLab,一个面向文本聚类研究的综合框架。该框架采用大语言模型(LLM)驱动的文本聚类数据生成器,可生成具有多种聚类属性(如类别不平衡、簇内紧凑性、簇间多样性)的合成文本数据集,为算法鲁棒性和泛化能力测试提供实用基准。同时,我们设计了一个基准测试方法,用于验证文本数据集是否适合作为聚类评估基础。TextClusterLab实现了可复现、全面的文本聚类研究支持。项目代码已开源(https://github.com/research-paper-code/TextClusterLab),部分示例数据集也公开于Hugging Face(https://huggingface.co/datasets/DW-irlab/TextClusterLab)。

原文摘要 · Abstract (English)

In recent years, text clustering has become a critical technique for applications including intent discovery, topic mining, and recommendation systems. However, evaluating text clustering algorithms remains challenging since many real-world textual datasets are not suitable for clustering assessment due to ambiguous semantic boundaries, the high dimensionality of embeddings, and inconsistent cluster structure. Current clustering dataset generators are designed for numerical data, providing limited support for text-specific benchmarking. This paper introduces TextClusterLab, a comprehensive framework for text clustering research. TextClusterLab offers a Large Language Model (LLM)-driven text clustering dataset generator to produce synthetic text datasets for evaluating clustering algorithms. This generator supports setting various clustering attributes, such as class imbalance, intra-cluster compactness, and inter-cluster diversity. These generated datasets can serve as practical benchmarks for testing the robustness and versatility of text clustering algorithms in diverse scenarios. Moreover, we introduce a benchmark to verify whether a text dataset is suitable for clustering evaluation. Therefore, TextClusterLab provides an integrated framework for reproducible and comprehensive text-specific clustering research. Our TextClusterLab is publicly available at https://github.com/research-paper-code/TextClusterLab, and some synthetic example datasets with various attributes are publicly available at https://huggingface.co/datasets/DW-irlab/TextClusterLab.

文本聚类数据生成大模型评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。