arXiv:2609.04511cs.CL2026-09

用合成数据和指令微调,让小模型高效提取文本中的隐含实体。

LentEx: Generalizable Latent Entity Extraction via Synthetic Data and Instruction-Tuned LLMs

论文配图:LentEx: Generalizable Latent Entity Extraction via Synthetic Data and Instruction-Tuned LLMs
图 1 · 摘自论文原文
  • 基于模板生成多样合成数据,解决标注数据稀缺问题。
  • 在MTEB聚类基准上超越现有模型,泛化能力突出。
  • 适合需要理解抽象主题的RAG、用户画像等场景。

隐含实体抽取(LEE)旨在从自由文本中识别出依赖上下文推断出的抽象实体,传统方法难以应对。本文提出LentEx框架,利用合成数据生成与指令微调技术优化小型高效大语言模型。隐含实体常为抽象或主题性概念,对检索增强生成(RAG)、客户画像分析、知识图谱丰富等应用至关重要。针对标注数据稀缺问题,LentEx采用基于模板的合成数据生成方法,确保数据多样性与真实分布一致。据我们所知,LentEx是首个系统性通过大语言模型实现LEE的方法。实验表明,该方法在多个任务中显著提升性能,尤其在MTEB聚类基准上超越现有最先进模型。此外,其方法具备强泛化能力,可有效应用于未见领域,适用于RAG与聚类等实际NLP任务,为自然语言处理中的隐含实体理解与抽取树立新范式。

原文摘要 · Abstract (English)

Latent entity extraction (LEE) tackles the challenge of identifying implicit, contextually inferred entities within free text-an area where traditional entity extraction methods fall short. In this paper, we introduce LentEx, a novel framework for latent entity extraction that leverages synthetic data generation and instruction fine-tuning to optimize smaller, efficient large language models (LLMs). Latent entities, which are often abstract and thematic, are crucial for applications such as retrieval-augmented generation (RAG), customer persona analysis, and knowledge graph enrichment. LentEx addresses the scarcity of labeled datasets by employing a template-based approach to generate diverse, contextually rich synthetic data, ensuring high variability and alignment with real-world distributions. To our knowledge, LentEx is the first to systematically approach LEE through the lens of LLMs. LentEx demonstrates significant performance improvements across multiple tasks, notably surpassing state-of-the-art models on the MTEB Clustering Benchmark. Furthermore, our methodology enables robust generalization to unseen domains, making LentEx highly applicable in real-world NLP tasks, including RAG and clustering, thereby establishing a new paradigm for latent entity understanding and extraction in natural language processing.

实体抽取合成数据LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。