arXiv:2504.05320cs.IRcs.LG2025-04被引 1

用可解释的多词搜索查询自动聚类文档,准确率高且结果易懂。

Document clustering with evolved multiword search queries

  • 用演化算法优化多词搜索查询,每条查询生成一个聚类。
  • 在8个数据集上准确率超主流算法,未被覆盖文档用KNN补全。
  • 查询可读可调,能解释为何文档被分到同一组。

文本聚类在多个领域具有重要价值,能识别模式并归类相关信息。现有方法依赖计算相似度,常受限于准确率和可解释性。本文提出一种新方法:通过一组演化的搜索查询进行聚类,每个聚类由一条查询匹配的文档构成。查询被优化以最大化返回文档数,并最小化聚类间重叠(即文档被多条查询命中)。多词查询采用或关系解释,设定一个根词,其余词返回的文档集必须与根词交集非空。并非所有文档都会被查询命中,因此在查询演化完成后,使用KNN将剩余文档分配至最近聚类。我们在8个文本数据集上评估该方法,结果表明其在准确率上优于现有主流算法,同时具备可解释、可修改的优点,并提供聚类形成的因果说明。

原文摘要 · Abstract (English)

Text clustering holds significant value across various domains due to its ability to identify patterns and group related information. Current approaches which rely heavily on a computed similarity measure between documents are often limited in accuracy and interpretability. We present a novel approach to the problem based on a set of evolved search queries. Clusters are formed as the set of documents matched by a single search query in the set of queries. The queries are optimized to maximize the number of documents returned and to minimize the overlap between clusters (documents returned by more than one query). Where queries contain more than one word they are interpreted disjunctively. We have found it useful to assign one word to be the root and constrain the query construction such that the set of documents returned by any additional query words intersect with the set returned by the root word. Not all documents in a collection are returned by any of the search queries in a set, so once the search query evolution is completed a second stage is performed whereby a KNN algorithm is applied to assign all unassigned documents to their nearest cluster. We describe the method and present results using 8 text datasets comparing effectiveness with well-known existing algorithms. We note that as well as achieving the highest accuracy on these datasets the search query format provides the qualitative benefits of being interpretable and modifiable whilst providing a causal explanation of cluster construction.

文本聚类可解释性搜索查询演化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。