arXiv:2503.02053cs.AIcs.CL2025-03被引 2

提出EPEE方法,让生物医学大模型推理更快更准。

EPEE: Towards Efficient and Effective Foundation Models in Biomedicine

  • 结合熵与耐心机制,动态提前终止推理过程
  • 在12个数据集上平均提速40%以上,准确率不降反升
  • 适合需要实时响应的临床决策系统使用

基础模型(如GPT、CLIP)显著推进了多项生物医学任务。然而,高推理延迟和“过度思考”问题影响了其效率与效果,限制了在实时临床场景中的应用。为此,我们提出EPEE(基于熵与耐心的早期退出),一种新型混合策略,旨在提升基础模型的推理效率。核心思想是融合熵基与耐心基早期退出方法的优势,克服各自的不足。我们在三个核心生物医学任务——分类、关系抽取与事件抽取——上,使用四种基础模型(BERT、ALBERT、GPT-2、ViT)在十二个数据集(包括临床笔记与医学影像)上验证EPEE。结果表明,EPEE显著降低了推理时间,同时保持或提升了准确率,展现出对多样化数据与任务的良好适应性。该方法有效缓解了基础模型在医疗领域部署的关键障碍,为实时临床决策提供了高效可靠的解决方案。

原文摘要 · Abstract (English)

Foundation models, including language models, e.g., GPT, and vision models, e.g., CLIP, have significantly advanced numerous biomedical tasks. Despite these advancements, the high inference latency and the "overthinking" issues in model inference impair the efficiency and effectiveness of foundation models, thus limiting their application in real-time clinical settings. To address these challenges, we proposed EPEE (Entropy- and Patience-based Early Exiting), a novel hybrid strategy designed to improve the inference efficiency of foundation models. The core idea was to leverage the strengths of entropy-based and patience-based early exiting methods to overcome their respective weaknesses. To evaluate EPEE, we conducted experiments on three core biomedical tasks-classification, relation extraction, and event extraction-using four foundation models (BERT, ALBERT, GPT-2, and ViT) across twelve datasets, including clinical notes and medical images. The results showed that EPEE significantly reduced inference time while maintaining or improving accuracy, demonstrating its adaptability to diverse datasets and tasks. EPEE addressed critical barriers to deploying foundation models in healthcare by balancing efficiency and effectiveness. It potentially provided a practical solution for real-time clinical decision-making with foundation models, supporting reliable and efficient workflows.

大模型优化医疗AI推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。