arXiv:2603.13776cs.IRcs.AI2026-03被引 2

用检索反馈训练小模型,高效实现查询扩展。

Retrieval-Feedback-Driven Distillation and Preference Alignment for Efficient LLM-based Query Expansion

  • 通过教师模型生成零样本和少样本扩展,指导学生模型学习。
  • 在TREC DL19上,小模型达教师模型97%的nDCG@10性能。
  • 适合需低成本部署的大语言模型检索系统开发者。

大语言模型虽推动了生成式查询扩展,但高推理成本限制其在实际检索系统中的应用。为此,提出一种基于检索反馈的蒸馏与偏好对齐框架,将强教师模型的检索友好型扩展行为迁移到紧凑的学生模型中。该框架不依赖推理时的少样本示例,而是利用教师模型在零样本和少样本提示下生成的两类扩展作为蒸馏监督信号,并构建偏好候选池。引入基于检索指标的策略,根据nDCG@10差异自动构造选中/拒绝扩展对,再通过直接偏好优化显式对齐生成偏好与检索目标。在TREC DL19/20/21和MIRACL-zh数据集上的实验表明,该方法在显著降低推理开销的同时保持强检索效果。尤其在DL19上,蒸馏后的Qwen3-4B模型达到教师模型(DeepSeek-685B)约97%的nDCG@10性能,且在中文MIRACL-zh基准上表现良好,证明其在中英文检索场景下的实用性。

原文摘要 · Abstract (English)

Large language models have recently enabled a generative paradigm for query expansion, but their high inference cost makes direct deployment difficult in practical retrieval systems. To address this issue, a retrieval-feedback-driven distillation and preference-alignment framework is proposed to transfer retrieval-friendly expansion behavior from a strong teacher model to a compact student model. Rather than relying on few-shot exemplars at inference time, the framework first leverages two complementary types of teacher-generated expansions, produced under zero-shot and few-shot prompting conditions, as supervision signals for distillation and as candidate pools for preference construction. A retrieval-metric-driven strategy is then introduced to automatically form chosen/rejected expansion pairs according to nDCG@10 differences, and Direct Preference Optimization is applied to explicitly align generation preferences with retrieval objectives. Experiments on TREC DL19/20/21 and MIRACL-zh show that the proposed approach preserves strong retrieval effectiveness while substantially reducing inference cost. In particular, the distilled Qwen3-4B model reaches about 97% of the teacher (DeepSeek-685B) model's nDCG@10 performance on DL19, and remains effective on the Chinese MIRACL-zh benchmark, demonstrating strong practicality across both English and Chinese retrieval settings.

查询扩展模型蒸馏检索优化小模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。