针对医疗大模型适配难题,提出基于难度分解的数据筛选方法
3DS: Medical Domain Adaptation of LLMs via Decomposed Difficulty-based Data Selection
- 根据模型自身知识分布,分两阶段筛选数据
- 医疗领域实验显示准确率提升超5.29%
- 适合需要精准领域适配的医疗AI研发人员
大型语言模型在通用任务中表现优异,但在医疗等专业领域因缺乏领域知识而表现受限。现有监督微调数据构建依赖启发式方法(如GPT-4标注或人工筛选),聚焦数据多样性与质量,却忽视模型内在知识分布,导致引入噪声、冗余和无关数据,造成数据与学习任务不匹配,影响性能。为此,我们提出两阶段以模型为中心的数据筛选框架——分解难度数据选择(3DS),使数据更契合模型知识分布。第一阶段采用提示驱动的数据筛选,基于模型内部知识过滤无关或冗余内容;第二阶段通过定义的难度分解机制,结合指令理解、响应置信度和响应正确性三项指标进行筛选,并引入注意力加权机制捕捉标记重要性,实现更精准的难度校准。该方法确保所选数据既符合模型认知又具备适当挑战性,显著提升领域适配效果。在真实医疗数据集上的大量实验表明,3DS在准确率上优于现有方法超过5.29%。代码与数据已开源。
原文摘要 · Abstract (English)
Large Language Models(LLMs) excel in general tasks but struggle in specialized domains like healthcare due to limited domain-specific knowledge.Supervised Fine-Tuning(SFT) data construction for domain adaptation often relies on heuristic methods, such as GPT-4 annotation or manual data selection, with a data-centric focus on presumed diverse, high-quality datasets. However, these methods overlook the model's inherent knowledge distribution, introducing noise, redundancy, and irrelevant data, leading to a mismatch between the selected data and the model's learning task, resulting in suboptimal performance. To address this, we propose a two-stage model-centric data selection framework, Decomposed Difficulty Data Selection (3DS), which aligns data with the model's knowledge distribution for optimized adaptation. In Stage1, we apply Prompt-Driven Data Selection via Explicit Alignment, where the the model filters irrelevant or redundant data based on its internal knowledge. In Stage2, we perform Decomposed Difficulty Data Selection, where data selection is guided by our defined difficulty decomposition, using three metrics: Instruction Understanding, Response Confidence, and Response Correctness. Additionally, an attention-based importance weighting mechanism captures token importance for more accurate difficulty calibration. This two-stage approach ensures the selected data is not only aligned with the model's knowledge and preferences but also appropriately challenging for the model to learn, leading to more effective and targeted domain adaptation. In the case study of the medical domain, our extensive experiments on real-world healthcare datasets demonstrate the superiority of 3DS over exisiting methods in accuracy by over 5.29%. Our dataset and code has been open-sourced at https://github.com/PuppyKnightUniversity/3DS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。