仅用实体名和标签,自动获取描述文本实现小众实体分类
Dynamically Acquiring Text Content to Enable the Classification of Lesser-known Entities for Real-world Tasks

- 结合网络与大模型动态获取实体描述文本
- 在工业分类和医疗分类任务上分别达82.3%和72.9%的宏F1
- 适合缺乏标注数据的领域专家快速构建分类器
现有自然语言处理资源常缺少真实场景中所需的任务特定信息,且对不知名或新出现的实体覆盖有限。例如,企业与医疗机构需根据具体应用任务划分为多种分类体系。本文目标是让领域专家仅提供实体名称和真实标签,即可快速构建任务专属分类器。框架通过动态获取每个实体的描述性文本,作为生成文本分类器的基础。提出一种融合网络与大语言模型的新文本获取方法,在两个不同领域的分类任务上进行评估:(i)将组织按标准行业分类代码(SIC Code)分类;(ii)将医疗提供者按医疗提供者分类代码分类。最佳模型在SIC代码分类任务上达到82.3%的宏平均F1,在医疗分类任务上为72.9%。
原文摘要 · Abstract (English)
Existing Natural Language Processing (NLP) resources often lack the task-specific information required for real-world problems and provide limited coverage of lesser-known or newly introduced entities. For example, business organizations and health care providers may need to be classified into a variety of different taxonomic schemes for specific application tasks. Our goal is to enable domain experts to easily create a task-specific classifier for entities by providing only entity names and gold labels as training data. Our framework then dynamically acquires descriptive text about each entity, which is subsequently used as the basis for producing a text-based classifier. We propose a novel text acquisition method that leverages both web and large language models (LLMs). We evaluate our proposed framework on two classification problems in distinct domains: (i) classifying organizations into Standard Industrial Classification (SIC) Codes, which categorize organizations based on their business activities; and (ii) classifying healthcare providers into healthcare provider taxonomy codes, which represent a provider's medical specialty and area of practice. Our best-performing model achieved macro-averaged F1-scores of 82.3% and 72.9% on the SIC code and healthcare taxonomy code classification tasks, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。