用大模型融合检索与重排,提升生物医学问答准确率
Beyond Retrieval: Ensembling Cross-Encoders and GPT Rerankers with LLMs for Biomedical QA
- 用交叉编码器+大模型集成重排,提升文献检索相关性
- 事实类问题MRR达0.64,排名榜首;封闭式问题F1为0.95
- 适合需要精准医学知识的科研与临床人员使用
基于信息检索的生物医学语义问答系统在应对海量快速更新的生物医学文献中具有关键作用。本论文介绍了参与BioASQ 2025 Task13b挑战的方法与结果,构建了一个检索增强生成(RAG)系统,通过从PubMed中检索相关文献和段落来生成答案。检索阶段采用生物医学文章的稠密嵌入进行初步检索,并利用微调后的交叉编码器与大语言模型(LLMs)集成进行重排,以识别最相关的文档。该方案在检索任务中取得MAP@10为0.1581,位列第10。答案生成阶段采用指令微调的大模型进行少样本提示,系统在封闭式问题上实现宏F1为0.95(排名第12),事实类问题的均倒数排名(MRR)为0.64(排名第1),列表类问题的均F1为0.63(排名第5),理想答案的ROUGE-SU4 F1为0.29(排名第11)。
原文摘要 · Abstract (English)
Biomedical semantic question answering rooted in information retrieval can play a crucial role in keeping up to date with vast, rapidly evolving and ever-growing biomedical literature. A robust system can help researchers, healthcare professionals and even layman users access relevant knowledge grounded in evidence. The BioASQ 2025 Task13b Challenge serves as an important benchmark, offering a competitive platform for advancement of this space. This paper presents the methodologies and results from our participation in this challenge where we built a Retrieval-Augmented Generation (RAG) system that can answer biomedical questions by retrieving relevant PubMed documents and snippets to generate answers. For the retrieval task, we generated dense embeddings from biomedical articles for initial retrieval, and applied an ensemble of finetuned cross-encoders and large language models (LLMs) for re-ranking to identify top relevant documents. Our solution achieved an MAP@10 of 0.1581, placing 10th on the leaderboard for the retrieval task. For answer generation, we employed few-shot prompting of instruction-tuned LLMs. Our system achieved macro-F1 score of 0.95 for yes/no questions (rank 12), Mean Reciprocal Rank (MRR) of 0.64 for factoid questions (rank 1), mean-F1 score of 0.63 for list questions (rank 5), and ROUGE-SU4 F1 score of 0.29 for ideal answers (rank 11).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。