arXiv:2509.08596cs.CL2025-09被引 3

用多个大模型集成提升生物医学问答准确率,无需调优。

LLM Ensemble for RAG: Role of Context Length in Zero-Shot Question Answering for BioASQ Challenge

  • 多模型零样本集成,融合Anthropic与Google的LLM输出
  • 在BioASQ挑战中表现超越单个模型,接近专业调优系统
  • 强调上下文长度需精准控制,避免信息稀释

生物医学问答因需从庞大、复杂且快速演进的知识库中精确理解专业信息而极具挑战。本文探索大语言模型(LLMs)在信息检索(IR)中的应用,证明多模型零样本集成可在特定领域是/否问答任务上达到顶尖性能。在BioASQ挑战任务上评估表明,集成方法优于单个LLM,某些情况下可媲美甚至超越领域调优系统,同时保持泛化能力,无需昂贵微调或标注数据。该方法整合来自Anthropic和Google的多种LLM变体输出,生成更准确、更鲁棒的答案。研究还揭示了上下文长度与性能之间的关系:虽然扩展上下文旨在提供更多信息,但可能引发信息稀释和模型迷失。结果强调了信息检索在生物医学问答的检索增强生成(RAG)框架中的基础作用。精确、聚焦的检索对确保LLM在生成答案时处于相关知识边界至关重要。研究表明,结合有效RAG流程的集成式零样本方法,为生物医学问答提供了一种实用且可扩展的替代方案。

原文摘要 · Abstract (English)

Biomedical question answering (QA) poses significant challenges due to the need for precise interpretation of specialized knowledge drawn from a vast, complex, and rapidly evolving corpus. In this work, we explore how large language models (LLMs) can be used for information retrieval (IR), and an ensemble of zero-shot models can accomplish state-of-the-art performance on a domain-specific Yes/No QA task. Evaluating our approach on the BioASQ challenge tasks, we show that ensembles can outperform individual LLMs and in some cases rival or surpass domain-tuned systems - all while preserving generalizability and avoiding the need for costly fine-tuning or labeled data. Our method aggregates outputs from multiple LLM variants, including models from Anthropic and Google, to synthesize more accurate and robust answers. Moreover, our investigation highlights a relationship between context length and performance: while expanded contexts are meant to provide valuable evidence, they simultaneously risk information dilution and model disorientation. These findings emphasize IR as a critical foundation in Retrieval-Augmented Generation (RAG) approaches for biomedical QA systems. Precise, focused retrieval remains essential for ensuring LLMs operate within relevant information boundaries when generating answers from retrieved documents. Our results establish that ensemble-based zero-shot approaches, when paired with effective RAG pipelines, constitute a practical and scalable alternative to domain-tuned systems for biomedical question answering.

生物医学问答零样本模型集成RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。