用大模型从表格中自动推导出概念层级,提升数据理解与管理效率。
Taxonomy Inference for Tabular Data Using Large Language Models
- 用对比学习微调BERT等编码器模型,通过聚类构建概念层级
- 用GPT-4迭代提示生成表格实体类型及其层次结构
- 在三个真实数据集上表现优于传统方法,适合数据治理与知识图谱构建
表格数据的分类体系推断是模式推断的关键任务,旨在发现表格中实体类型(即概念)并建立其层级关系,在数据管理、数据探索、本体学习及诸多以数据为中心的应用中具有重要作用。现有模式推断系统多聚焦于XML、JSON或RDF数据,常依赖数据的词法格式与结构计算相似性,对跨表文本语义利用有限。受近期基于大语言模型(LLM)进行分类体系补全与构建工作的启发,本文提出两种基于LLM的表格分类体系推断方法:(i) EmTT,通过对比学习微调BERT等编码器类大模型对列进行嵌入,并利用聚类构建层级;(ii) GeTT,通过迭代提示使用GPT-4等解码器类大模型生成表格实体类型及其层级结构。在三个真实世界数据集上,采用六项涵盖输出分类体系不同方面的指标进行广泛评估,结果表明EmTT和GeTT均可生成与真实标签高度一致的分类体系。
原文摘要 · Abstract (English)
Taxonomy inference for tabular data is a critical task of schema inference, aiming at discovering entity types (i.e., concepts) of the tables and building their hierarchy. It can play an important role in data management, data exploration, ontology learning, and many data-centric applications. Existing schema inference systems focus more on XML, JSON or RDF data, and often rely on lexical formats and structures of the data for calculating similarities, with limited exploitation of the semantics of the text across a table. Motivated by recent works on taxonomy completion and construction using Large Language Models (LLMs), this paper presents two LLM-based methods for taxonomy inference for tables: (i) EmTT which embeds columns by fine-tuning with contrastive learning encoder-alone LLMs like BERT and utilises clustering for hierarchy construction, and (ii) GeTT which generates table entity types and their hierarchy by iterative prompting using a decoder-alone LLM like GPT-4. Extensive evaluation on three real-world datasets with six metrics covering different aspects of the output taxonomies has demonstrated that EmTT and GeTT can both produce taxonomies with strong consistency relative to the Ground Truth.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。