arXiv:2506.19992cs.LGcs.AI2025-06被引 3

用大模型生成聚类标题,让复杂数据自动分层归纳

HERCULES: Hierarchical Embedding-based Recursive Clustering Using LLMs for Efficient Summarization

  • 递归调用k-means构建多层级聚类结构
  • 大模型生成每层聚类的语义标题与描述,提升可解释性
  • 支持文本/图像/数值数据,适合需要层次化洞察的研究者

多模态数据的爆炸式增长亟需高效分析工具,不仅能有效分组数据,还能提供可理解的结构洞察。我们提出HERCULES(基于大模型的分层嵌入递归聚类算法),一种用于文本、图像和数值数据(单次处理一模态)的层次化k-means聚类方法。该算法从零层的单个数据点开始,递归应用k-means构建聚类层次结构。其核心创新在于深度集成大语言模型(LLMs),为每一层级聚类生成语义丰富的标题与描述,显著提升结果可读性。支持两种表示模式:`direct'模式(基于原始嵌入或缩放后的数值特征聚类)和`description'模式(基于大模型生成摘要的嵌入聚类)。用户可通过`topic_seed'引导生成主题相关的摘要。配套交互式可视化工具助力深入分析。实证展示了HERCULES从复杂数据中提取有意义层次知识的潜力。

原文摘要 · Abstract (English)

The explosive growth of complex datasets across various modalities necessitates advanced analytical tools that not only group data effectively but also provide human-understandable insights into the discovered structures. We introduce HERCULES (Hierarchical Embedding-based Recursive Clustering Using LLMs for Efficient Summarization), a novel algorithm and Python package designed for hierarchical k-means clustering of diverse data types, including text, images, and numeric data (processed one modality per run). HERCULES constructs a cluster hierarchy by recursively applying k-means clustering, starting from individual data points at level 0. A key innovation is its deep integration of Large Language Models (LLMs) to generate semantically rich titles and descriptions for clusters at each level of the hierarchy, significantly enhancing interpretability. The algorithm supports two main representation modes: `direct' mode, which clusters based on original data embeddings or scaled numeric features, and `description' mode, which clusters based on embeddings derived from LLM-generated summaries. Users can provide a `topic\_seed' to guide LLM-generated summaries towards specific themes. An interactive visualization tool facilitates thorough analysis and understanding of the clustering results. We demonstrate HERCULES's capabilities and discuss its potential for extracting meaningful, hierarchical knowledge from complex datasets.

聚类分析大模型可解释性层次结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。