构建法语医学指令数据集,提升大模型在医疗场景的中文理解能力
MedInjection-FR: Exploring the Role of Native, Synthetic, and Translated Data in Biomedical Instruction Tuning
- 融合原生、合成与翻译数据,构建57.1万条法语医学指令对
- 原生数据表现最优,混合使用可互补提升模型性能
- 适合法语医疗AI研究者和多语言医学大模型开发者
指令微调已成为使大语言模型(LLMs)适应特定领域提示的关键技术。然而,在医学等专业领域,高质量法语指令数据稀缺限制了有效监督。为此,我们提出MedInjection-FR,一个包含57.1万条指令-响应对的大规模法语生物医学指令数据集,数据来自原生、合成和翻译三类互补来源。我们设计了受控实验框架,系统评估数据来源对指令微调的影响,使用Qwen-4B-Instruct在七种配置下进行微调。结果表明,原生数据表现最强,而混合设置(尤其是原生与翻译数据结合)具有互补优势。仅使用合成数据效果较差,但在与原生数据平衡时仍具正向贡献。开放问答评估采用自动指标、LLM作为评判者及人类专家评审;尽管基于LLM的判断与人工评分相关性最高,但对冗长性敏感。研究强调数据真实性和多样性共同影响下游适配效果,异质监督可缓解原生法语医学指令数据稀缺问题。
原文摘要 · Abstract (English)
Instruction tuning has become essential for adapting large language models (LLMs) to follow domain-specific prompts. Yet, in specialized fields such as medicine, the scarcity of high-quality French instruction data limits effective supervision. To address this gap, we introduce MedInjection-FR, a large-scale French biomedical instruction dataset comprising 571K instruction-response pairs drawn from three complementary sources: native, synthetic, and translated data. We design a controlled experimental framework to systematically assess how data provenance affects instruction tuning, using Qwen-4B-Instruct fine-tuned across seven configurations combining these sources. Results show that native data yield the strongest performance, while mixed setups, particularly native and translated, provide complementary benefits. Synthetic data alone remains less effective but contributes positively when balanced with native supervision. Evaluation on open-ended QA combines automatic metrics, LLM-as-a-judge assessment, and human expert review; although LLM-based judgments correlate best with human ratings, they show sensitivity to verbosity. These findings highlight that data authenticity and diversity jointly shape downstream adaptation and that heterogeneous supervision can mitigate the scarcity of native French medical instructions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。