无需标注数据,用大模型自动提取术语并跨领域适用。
Crossing Domains without Labels: Distant Supervision for Term Extraction
- 用黑盒大模型生成伪标签,构建跨领域术语数据集。
- 在7个领域中5个超越现有方法,平均提升10个百分点。
- 适合需要低资源术语抽取的工业界和研究者使用。
自动术语提取(ATE)是文档标注、本体构建和专利分析等下游NLP任务的关键环节。当前顶尖方法依赖昂贵的人工标注,且在跨领域迁移时表现不佳,限制了实际应用。为此,我们构建了一个涵盖七个不同领域的综合性基准,支持文档级与语料级性能评估。我们提出一种基于大语言模型(LLM)的鲁棒方法,在通用和科学领域利用黑盒大模型生成伪标签以保证泛化性,并在此基础上微调首个用于ATE的LLM。为增强文档级一致性(下游任务所需),引入轻量后处理启发式规则。该方法在7个领域中的5个上优于现有方法,平均提升10个百分点。我们公开了数据集和微调模型,以推动该领域研究。
原文摘要 · Abstract (English)
Automatic Term Extraction (ATE) is a critical component in downstream NLP tasks such as document tagging, ontology construction and patent analysis. Current state-of-the-art methods require expensive human annotation and struggle with domain transfer, limiting their practical deployment. This highlights the need for more robust, scalable solutions and realistic evaluation settings. To address this, we introduce a comprehensive benchmark spanning seven diverse domains, enabling performance evaluation at both the document- and corpus-levels. Furthermore, we propose a robust LLM-based model that outperforms both supervised cross-domain encoder models and few-shot learning baselines and performs competitively with its GPT-4o teacher on this benchmark. The first step of our approach is generating psuedo-labels with this black-box LLM on general and scientific domains to ensure generalizability. Building on this data, we fine-tune the first LLMs for ATE. To further enhance document-level consistency, oftentimes needed for downstream tasks, we introduce lightweight post-hoc heuristics. Our approach exceeds previous approaches on 5/7 domains with an average improvement of 10 percentage points. We release our dataset and fine-tuned models to support future research in this area.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。