用嵌入层优化问答系统,提速提准还更稳定
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering
- 用无监督对比学习优化查询表示,重排检索结果
- 在4个基准上提升准确率,比基线快2-3倍
- 适合追求高效高精度的开放域问答应用
大型语言模型推动开放域问答(ODQA)发展,但现有检索-阅读流水线依赖多轮提示指令,导致计算开销大、不稳定且检索覆盖不足。本文提出EmbQA,一种基于嵌入层的框架,通过轻量线性层在无监督对比学习目标下优化查询表示,重新排序检索段落,突出最可能含正确答案的部分。同时引入探索性嵌入拓展模型潜在语义空间,多样化候选答案生成,并采用基于熵的选择机制自动选出最可信答案。在三个开源LLM、三种检索方法和四个ODQA基准上的实验证明,EmbQA在准确率和效率上均显著优于近期基线。
原文摘要 · Abstract (English)
Large language models have recently pushed open domain question answering (ODQA) to new frontiers. However, prevailing retriever-reader pipelines often depend on multiple rounds of prompt level instructions, leading to high computational overhead, instability, and suboptimal retrieval coverage. In this paper, we propose EmbQA, an embedding-level framework that alleviates these shortcomings by enhancing both the retriever and the reader. Specifically, we refine query representations via lightweight linear layers under an unsupervised contrastive learning objective, thereby reordering retrieved passages to highlight those most likely to contain correct answers. Additionally, we introduce an exploratory embedding that broadens the model's latent semantic space to diversify candidate generation and employs an entropy-based selection mechanism to choose the most confident answer automatically. Extensive experiments across three open-source LLMs, three retrieval methods, and four ODQA benchmarks demonstrate that EmbQA substantially outperforms recent baselines in both accuracy and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。