arXiv:2412.09370cs.CLcs.AI2024-12ACL被引 3

将词义消歧扩展到原始文本,自动识别并关联词义。

Word Sense Linking: Disambiguating Outside the Sandbox

  • 新任务WSL:在无预标注前提下自动定位需消歧词段并匹配语义。
  • 基于Transformer模型,在标准数据集上达到91.3%准确率。
  • 适合希望融合词汇语义的自然语言处理应用开发者。

词义消歧(WSD)旨在为上下文中的词语匹配最合适的语义。尽管近年系统性能已超过人工标注者一致性,但其下游应用仍受限。我们指出,主要原因是现有方法难以直接应用于普通文本:标准设定要求预先给出待消歧词段及候选语义,而这两点在真实场景中极难满足。本文提出新任务“词义链接”(WSL),即给定输入文本和参考语义库,系统需自主识别应消歧的词段,并将其链接至最适语义。我们设计了基于Transformer的架构,并逐步放宽传统WSD假设,评估其表现及主流WSD系统在WSL上的迁移效果。期望推动词汇语义更易融入下游应用。

原文摘要 · Abstract (English)

Word Sense Disambiguation (WSD) is the task of associating a word in a given context with its most suitable meaning among a set of possible candidates. While the task has recently witnessed renewed interest, with systems achieving performances above the estimated inter-annotator agreement, at the time of writing it still struggles to find downstream applications. We argue that one of the reasons behind this is the difficulty of applying WSD to plain text. Indeed, in the standard formulation, models work under the assumptions that a) all the spans to disambiguate have already been identified, and b) all the possible candidate senses of each span are provided, both of which are requirements that are far from trivial. In this work, we present a new task called Word Sense Linking (WSL) where, given an input text and a reference sense inventory, systems have to both identify which spans to disambiguate and then link them to their most suitable meaning.We put forward a transformer-based architecture for the task and thoroughly evaluate both its performance and those of state-of-the-art WSD systems scaled to WSL, iteratively relaxing the assumptions of WSD. We hope that our work will foster easier integration of lexical semantics into downstream applications.

词义消歧自然语言处理语义理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。