用模块化设计提升生物医学问答效率,检索生成双优化。
BIT.UA at BioASQ 14B: Modular Retrieval with pg_textsearch and Qdrant, and Agent-Based Answer Generation
- 用PostgreSQL+Qdrant替代旧索引,支持GPU加速相似度搜索。
- 引入代理共识机制,多模型协作生成更可靠答案。
- 在多个批次中达到前五名,代码开源可复现。
本文介绍里斯本大学比特团队在第14届BioASQ Task B生物医学问答挑战中的参与情况。基于以往工作,我们重构了代码架构,显著改进了检索与生成流程。在阶段A文档检索中,采用PostgreSQL的pg_textsearch实现BM25检索,并引入Qdrant进行密集向量索引,支持高效存储与GPU加速相似性搜索;探索了HyDE查询扩展与Context-1检索策略。开发了新的重排序训练流程,利用密集检索进行负样本采样。在阶段A+和B的答案生成中,提出基于LLM评判的框架与新型代理共识机制,多个代理通过多样化提示辩论并迭代收敛至一致答案,支持自适应文档保留。首次参与片段生成子任务。系统在所有批次中表现优异,阶段A在第1、3批次中取得MAP排名第五。讨论了架构改进的影响、经验教训,并展望未来集成SPLADE和ColBERT的方向。所有代码已公开:https://github.com/bioinformatics-ua/BioASQ14b。
原文摘要 · Abstract (English)
This paper describes the participation of the BIT.UA team from the University of Aveiro in the 14th edition of the BioASQ Task B challenge on biomedical question answering. Building on our previous submissions, we introduced a substantially refactored and modular codebase, and made significant changes to both the retrieval and generation components of the pipeline. For Phase~A document retrieval, we replaced the PyTerrier PISA index with PostgreSQL-based pg\_textsearch for BM25 retrieval and adopted Qdrant for dense embedding indexing, enabling more efficient storage and GPU-accelerated similarity search. We explored HyDE-based query expansion alongside a Context-1 retrieval strategy. A new reranker training pipeline was developed, incorporating dense retrieval for negative sampling. For Phases A+ and B answer generation, we introduced an LLM-as-a-judge framework and a novel agent quorum mechanism, where multiple agents with diverse prompts debate and iteratively converge on a consensus answer using adaptive document retention. We also participated in the snippets generation subtask for the first time. Our systems achieved competitive results across all batches, with Phase~A systems achieving MAP ranks of 5 (Batch~1,3). We discuss the impact of these architectural changes, lessons learned, and outline directions for future work including SPLADE and ColBERT integration. All code is openly available: https://github.com/bioinformatics-ua/BioASQ14b.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。