构建多语言医学大模型数据集,提升低资源语言医疗AI表现
Toward Global Large Language Models in Medicine
- 构建含12种语言的50万条医疗数据集GlobMed
- 多语言医疗模型在低资源语言上性能提升超3倍
- 适合关注全球医疗公平与多语言AI的研究者
尽管医疗技术持续进步,全球医疗资源分布仍不均衡。大语言模型(LLMs)的发展为改善医疗质量和扩大医疗信息获取提供了可能,但现有模型主要基于高资源语言训练,限制了其在全球医疗场景中的应用。为此,我们构建了GlobMed,一个包含超过50万条记录、覆盖12种语言(包括四种低资源语言)的大型多语言医学数据集。基于此,我们建立了GlobMed-Bench,系统评估了56个前沿专有和开源大模型在多个多语言医疗任务上的表现,揭示了语言间显著的性能差异,尤其体现在低资源语言上。此外,我们推出了GlobMed-LLMs系列多语言医学大模型,参数量从1.7B到8B不等,在基准模型基础上平均性能提升超过40%,在低资源语言上性能提升超过三倍。这些资源为推动全球范围内大语言模型的公平发展与应用奠定了重要基础,使更多语言群体能受益于技术进步。
原文摘要 · Abstract (English)
Despite continuous advances in medical technology, the global distribution of health care resources remains uneven. The development of large language models (LLMs) has transformed the landscape of medicine and holds promise for improving health care quality and expanding access to medical information globally. However, existing LLMs are primarily trained on high-resource languages, limiting their applicability in global medical scenarios. To address this gap, we constructed GlobMed, a large multilingual medical dataset, containing over 500,000 entries spanning 12 languages, including four low-resource languages. Building on this, we established GlobMed-Bench, which systematically assesses 56 state-of-the-art proprietary and open-weight LLMs across multiple multilingual medical tasks, revealing significant performance disparities across languages, particularly for low-resource languages. Additionally, we introduced GlobMed-LLMs, a suite of multilingual medical LLMs trained on GlobMed, with parameters ranging from 1.7B to 8B. GlobMed-LLMs achieved an average performance improvement of over 40% relative to baseline models, with a more than threefold increase in performance on low-resource languages. Together, these resources provide an important foundation for advancing the equitable development and application of LLMs globally, enabling broader language communities to benefit from technological advances.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。