arXiv:2601.20084cs.IR2026-01Conference of the …被引 3

通过动态调制提升检索可解释性,同时增强效果

IMRNNs: An Efficient Method for Interpretable Dense Retrieval via Embedding Modulation

  • 用双向调制适配器动态调整查询与文档嵌入
  • 在7个数据集上平均提升nDCG 6.35%、召回率7.14%
  • 适合需要透明化检索过程的RAG系统开发者

黑箱密集检索模型的可解释性仍是检索增强生成(RAG)中的核心挑战。理解查询与文档间的语义交互对诊断检索行为和改进模型设计至关重要。然而,现有密集检索器使用静态嵌入,掩盖了这种双向关系。事后重排序等方法计算开销大,增加推理延迟,仍无法揭示底层语义对齐。为此,我们提出可解释模块化检索神经网络(IMRNNs),一种轻量级框架,在推理时为任意密集检索器引入动态双向调制。IMRNNs采用两个独立适配器:一个根据当前查询调节文档嵌入,另一个利用初始检索文档的全局反馈优化查询嵌入。此迭代调制过程使表示动态适应,并暴露查询与文档间的可解释语义依赖。实证表明,IMRNNs不仅提升可解释性,还增强检索效果。在七个基准数据集上,应用于标准密集检索器后,平均取得+6.35% nDCG、+7.14% recall、+7.04% MRR的提升,优于最先进基线。结果表明,基于可解释性的调制既能解释也能提升RAG系统的检索性能。

原文摘要 · Abstract (English)

Interpretability in black-box dense retrievers remains a central challenge in Retrieval-Augmented Generation (RAG). Understanding how queries and documents semantically interact is critical for diagnosing retrieval behavior and improving model design. However, existing dense retrievers rely on static embeddings for both queries and documents, which obscures this bidirectional relationship. Post-hoc approaches such as re-rankers are computationally expensive, add inference latency, and still fail to reveal the underlying semantic alignment. To address these limitations, we propose Interpretable Modular Retrieval Neural Networks (IMRNNs), a lightweight framework that augments any dense retriever with dynamic, bidirectional modulation at inference time. IMRNNs employ two independent adapters: one conditions document embeddings on the current query, while the other refines the query embedding using corpus-level feedback from initially retrieved documents. This iterative modulation process enables the model to adapt representations dynamically and expose interpretable semantic dependencies between queries and documents. Empirically, IMRNNs not only enhance interpretability but also improve retrieval effectiveness. Across seven benchmark datasets, applying our method to standard dense retrievers yields average gains of +6.35% nDCG, +7.14% recall, and +7.04% MRR over state-of-the-art baselines. These results demonstrate that incorporating interpretability-driven modulation can both explain and enhance retrieval in RAG systems.

可解释性检索增强嵌入调制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。