提升检索模型对关键词和片段的精准匹配能力
LexSemBridge: Fine-Grained Dense Representation Enhancement through Token-Aware Embedding Augmentation
- 通过输入感知的向量调制增强查询表示
- 在细粒度检索任务上显著超越基线模型
- 可无缝集成到多模态系统中使用
随着大语言模型驱动的检索增强生成管道中查询日益复杂多样,密集检索模型在语义匹配方面表现出色。然而,在需要精确关键词对齐和片段级定位的细粒度检索任务中,即使存在高词面重叠,仍常表现不佳。为此,我们引入两个针对性任务:关键词检索与篇章片段检索,以模拟实际细粒度场景。受此启发,我们提出LexSemBridge,一种通过细粒度、输入感知的向量调制来增强密集查询表示的统一框架。该方法利用统计(SLR)、学习(LLR)和上下文(CLR)三种范式,从输入标记构建潜在增强向量,并通过逐元素交互融合至密集嵌入。理论上,这种调制在保持语义方向的同时,选择性放大判别性维度。LexSemBridge作为即插即用模块,无需修改主干编码器,天然支持文本与视觉模态。在语义及细粒度检索任务上的大量实验验证了方法的有效性与通用性。所有代码与模型均已公开于https://github.com/Jasaxion/LexSemBridge/
原文摘要 · Abstract (English)
As queries in retrieval-augmented generation (RAG) pipelines powered by large language models (LLMs) become increasingly complex and diverse, dense retrieval models have demonstrated strong performance in semantic matching. Nevertheless, they often struggle with fine-grained retrieval tasks, where precise keyword alignment and span-level localization are required, even in cases with high lexical overlap that would intuitively suggest easier retrieval. To systematically evaluate this limitation, we introduce two targeted tasks, keyword retrieval and part-of-passage retrieval, designed to simulate practical fine-grained scenarios. Motivated by these observations, we propose LexSemBridge, a unified framework that enhances dense query representations through fine-grained, input-aware vector modulation. LexSemBridge constructs latent enhancement vectors from input tokens using three paradigms: Statistical (SLR), Learned (LLR), and Contextual (CLR), and integrates them with dense embeddings via element-wise interaction. Theoretically, we show that this modulation preserves the semantic direction while selectively amplifying discriminative dimensions. LexSemBridge operates as a plug-in without modifying the backbone encoder and naturally extends to both text and vision modalities. Extensive experiments across semantic and fine-grained retrieval tasks validate the effectiveness and generality of our approach. All code and models are publicly available at https://github.com/Jasaxion/LexSemBridge/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。