arXiv:2504.00584cs.CLcs.AI2025-04中稿 · ECAI 2025 main tra…被引 1

解决通用文本嵌入模型对否定语义的忽视问题,提升其语义理解能力。

Semantic Adapter for Universal Text Embeddings: Diagnosing and Mitigating Negation Blindness to Enhance Universality

  • 提出嵌入重加权方法,不修改模型参数即可增强否定感知。
  • 在简单与复杂否定任务上显著提升模型对否定的理解能力。
  • 适用于多种通用嵌入模型,尤其适合大语言模型生成的高维嵌入。

否定在自然语言推理和情感分析等任务中至关重要。尽管近年来通用文本嵌入模型在多项任务上表现优于BERT、RoBERTa等上下文嵌入模型,但因主流评估基准存在偏差,其对否定的理解能力仍不明确。本文深入分析了前沿通用嵌入模型的否定感知能力,发现这些模型普遍存在否定盲区,常将否定句对误判为语义相似。为此,提出一种数据高效、计算高效的嵌入重加权方法,无需修改模型参数即可显著提升模型在简单与复杂否定理解任务中的表现。该方法还可有效增强基于大语言模型的任务特定高维通用嵌入模型的否定感知能力。

原文摘要 · Abstract (English)

Negation plays an important role in various natural language processing tasks such as Natural Language Inference and Sentiment Analysis tasks. Numerous prior studies have found that contextual text embedding models such as BERT, ELMO, RoBERTa or XLNet face challenges in accurately understanding negation. Recent advancements in universal text embeddings have demonstrated superior performance over contextual text embeddings in various tasks. However, due to the bias in popular evaluation benchmarks, the negation awareness capacity of these models remains unclear. To bridge the gap in existing literature, an in-depth analysis is initiated in this work to study the negation awareness of cutting-edge universal text embedding models. Our findings reveal a significant lack of negation awareness in these models, often interpreting negated text pairs as semantically similar. To efficiently deal with the conflict that different tasks need different trade-offs between topic and negation information among other semantic information, a data-efficient and computational-efficient embedding re-weighting method is proposed without modifying the parameters of text embedding models. The proposed solution is able to improve text embedding models' negation awareness significantly on both simple negation understanding task and complex negation understanding task. Furthermore, the proposed solution can also significantly improve the negation awareness of Large Language Model based task-specific high dimensional universal text embeddings.

文本嵌入否定理解通用表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。