arXiv:2605.06132cs.CL2026-05被引 3

让记忆检索更懂逻辑,提升问答准确率

MemReranker: Reasoning-Aware Reranking for Agent Memory Retrieval

论文配图:MemReranker: Reasoning-Aware Reranking for Agent Memory Retrieval
图 1 · 摘自论文原文
  • 用多阶段大模型蒸馏生成校准标签,增强推理能力
  • 在基准测试中0.6B模型超越BGE,4B版达0.737 MAP
  • 适合需要精准记忆检索的对话系统与垂直领域应用

在智能体记忆系统中,重排序模型是连接用户查询与长期记忆的关键桥梁。现有系统普遍采用‘检索-重排序’两阶段范式,但通用重排序模型依赖语义相似度匹配,缺乏真实推理能力,导致召回结果语义相关却缺少关键答案信息。具体表现为:相关性评分失准,难以设定阈值过滤;面对时间约束、因果推理等复杂查询时排名下降;无法利用对话上下文进行语义消歧。本文提出MemReranker(0.6B/4B),基于Qwen3-Reranker通过多阶段大模型知识蒸馏构建。多教师成对比较生成校准软标签,BCE点态蒸馏实现分数良好分布,InfoNCE对比学习强化难例区分。训练数据融合通用语料与包含时间约束、因果推理、指代消解的内存专用多轮对话数据。在内存检索基准上,MemReranker-0.6B显著优于BGE-Reranker,媲美开源4B/8B模型及GPT-4o-mini;MemReranker-4B进一步达到0.737 MAP,多项指标接近Gemini-3-Flash,推理延迟仅为大模型的10%-20%。在金融与医疗垂直领域基准上,模型保持与主流大参数重排序器相当的泛化能力。

原文摘要 · Abstract (English)

In agent memory systems, the reranking model serves as the critical bridge connecting user queries with long-term memory. Most systems adopt the "retrieve-then-rerank" two-stage paradigm, but generic reranking models rely on semantic similarity matching and lack genuine reasoning capabilities, leading to a problem where recalled results are semantically highly relevant yet do not contain the key information needed to answer the question. This deficiency manifests in memory scenarios as three specific problems. First, relevance scores are miscalibrated, making threshold-based filtering difficult. Second, ranking degrades when facing temporal constraints, causal reasoning, and other complex queries. Third, the model cannot leverage dialogue context for semantic disambiguation. This report introduces MemReranker, a reranking model family (0.6B/4B) built on Qwen3-Reranker through multi-stage LLM knowledge distillation. Multi-teacher pairwise comparisons generate calibrated soft labels, BCE pointwise distillation establishes well-distributed scores, and InfoNCE contrastive learning enhances hard-sample discrimination. Training data combines general corpora with memory-specific multi-turn dialogue data covering temporal constraints, causal reasoning, and coreference resolution. On the memory retrieval benchmark, MemReranker-0.6B substantially outperforms BGE-Reranker and matches open-source 4B/8B models as well as GPT-4o-mini on key metrics. MemReranker-4B further achieves 0.737 MAP, with several metrics on par with Gemini-3-Flash, while maintaining inference latency at only 10--20% of large models. On finance and healthcare vertical-domain benchmarks, the models preserve generalization capabilities on par with mainstream large-parameter rerankers.

记忆检索推理增强大模型蒸馏对话系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。