arXiv:2602.05734cs.IRcs.AI2026-02

用词间距离提升语义相似度,让搜索更懂用户意图。

Evaluating the impact of word embeddings on similarity scoring in practical information retrieval

  • 以单词间距离替代嵌入向量中心点,更精准捕捉语义关联。
  • WMD+GloVe组合在排名任务中超越主流模型,准确率显著提升。
  • 预训练词嵌入可跨领域复用,适合多样商业场景应用。

搜索行为常依赖同义与多义关系,用户希望基于语义而非字面匹配获取信息。语义表示策略通过建立更丰富的关联,更好捕捉语言的复杂性。向量空间模型(VSM)和神经词嵌入在现代机器学习与自然语言处理中至关重要,将词、句、段落或文档表示为高维空间中的向量,可用于信息检索系统挖掘查询与答案间的语义相关性。本文评估了一种替代传统嵌入中心点相似度的方法:基于词移距离(WMD)模型,直接计算查询与应答文本中单个词之间的距离。在排序任务中,结合WMD与词嵌入的方法显著提升了准确性。其中,WMD + GloVe组合性能优于所有现有先进模型,包括Doc2Vec与基线LSA模型。结果表明,基于大规模数据训练的预训练词嵌入能实现领域无关的语言处理,具备良好的可迁移性,适用于多种业务场景。

原文摘要 · Abstract (English)

Search behaviour is characterised using synonymy and polysemy as users often want to search information based on meaning. Semantic representation strategies represent a move towards richer associative connections that can adequately capture this complex usage of language. Vector Space Modelling (VSM) and neural word embeddings play a crucial role in modern machine learning and Natural Language Processing (NLP) pipelines. Embeddings use distributional semantics to represent words, sentences, paragraphs or entire documents as vectors in high dimensional spaces. This can be leveraged by Information Retrieval (IR) systems to exploit the semantic relatedness between queries and answers. This paper evaluates an alternative approach to measuring query statement similarity that moves away from the common similarity measure of centroids of neural word embeddings. Motivated by the Word Movers Distance (WMD) model, similarity is evaluated using the distance between individual words of queries and statements. Results from ranked query and response statements demonstrate significant gains in accuracy using the combined approach of similarity ranking through WMD with the word embedding techniques. The top performing WMD + GloVe combination outperforms all other state-of-the-art retrieval models including Doc2Vec and the baseline LSA model. Along with the significant gains in performance of similarity ranking through WMD, we conclude that the use of pre-trained word embeddings, trained on vast amounts of data, result in domain agnostic language processing solutions that are portable to diverse business use-cases.

语义相似度词嵌入信息检索WMD

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。