用大模型理解表格数据,提升聚类精度
ERASMO: Leveraging Large Language Models for Enhanced Clustering Segmentation
- 将表格数据转为文本,让大模型理解其上下文
- 通过随机打乱和数字转写生成更丰富的嵌入向量
- 在多个数据集上显著提升聚类效果,适合多模态分析
聚类分析在市场营销等众多领域至关重要,但涉及表格与文本的多模态数据时,隐藏模式难以表征,影响聚类质量。本文提出ERASMO框架,通过文本转换器将表格数据转化为文本格式,使预训练语言模型能够有效处理。该方法结合随机特征序列打乱与数字文字化技术,生成上下文丰富、结构敏感的嵌入表示。在多个数据集与基线方法上的实验表明,ERASMO能充分捕捉各表格数据的特定上下文,生成更精确、细致的嵌入,显著提升聚类性能,有效识别复杂关系模式。
原文摘要 · Abstract (English)
Cluster analysis plays a crucial role in various domains and applications, such as customer segmentation in marketing. These contexts often involve multimodal data, including both tabular and textual datasets, making it challenging to represent hidden patterns for obtaining meaningful clusters. This study introduces ERASMO, a framework designed to fine-tune a pretrained language model on textually encoded tabular data and generate embeddings from the fine-tuned model. ERASMO employs a textual converter to transform tabular data into a textual format, enabling the language model to process and understand the data more effectively. Additionally, ERASMO produces contextually rich and structurally representative embeddings through techniques such as random feature sequence shuffling and number verbalization. Extensive experimental evaluations were conducted using multiple datasets and baseline approaches. Our results demonstrate that ERASMO fully leverages the specific context of each tabular dataset, leading to more precise and nuanced embeddings for accurate clustering. This approach enhances clustering performance by capturing complex relationship patterns within diverse tabular data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。