用词义消歧提升医疗文本偏见检测,发现微调BERT优于大模型。
Towards Fairer Health Recommendations: finding informative unbiased samples via Word Sense Disambiguation
- 通过词义消歧剔除歧义语句,提升医疗数据集质量。
- 在4105条专家标注文本上测试,微调BERT表现最优。
- 提醒大模型不适合医疗偏见检测,适合医学领域研究者。
针对依赖有偏数据的高风险应用,特别是医疗推荐系统可能加剧健康不平等的问题,本文提出基于自然语言处理的偏见检测方法。研究基于包含4105个医学专家标注片段的黄金标准数据集,评估了大语言模型(LLMs)与微调BERT模型的表现。此前工作通过引入含社会标识词的未标注文本扩充负样本,但部分术语(如“white matter”)存在多义性,易导致误判。为此,本文引入词义消歧模型,剔除语义无关句子以提升数据质量。实验表明,尽管大模型在多数NLP任务中表现领先,但在医疗偏见检测中表现不佳;而微调后的BERT模型在所有指标上均表现稳定且优异。
原文摘要 · Abstract (English)
There have been growing concerns around high-stake applications that rely on models trained with biased data, which consequently produce biased predictions, often harming the most vulnerable. In particular, biased medical data could cause health-related applications and recommender systems to create outputs that jeopardize patient care and widen disparities in health outcomes. A recent framework titled Fairness via AI posits that, instead of attempting to correct model biases, researchers must focus on their root causes by using AI to debias data. Inspired by this framework, we tackle bias detection in medical curricula using NLP models, including LLMs, and evaluate them on a gold standard dataset containing 4,105 excerpts annotated by medical experts for bias from a large corpus. We build on previous work by coauthors which augments the set of negative samples with non-annotated text containing social identifier terms. However, some of these terms, especially those related to race and ethnicity, can carry different meanings (e.g., "white matter of spinal cord"). To address this issue, we propose the use of Word Sense Disambiguation models to refine dataset quality by removing irrelevant sentences. We then evaluate fine-tuned variations of BERT models as well as GPT models with zero- and few-shot prompting. We found LLMs, considered SOTA on many NLP tasks, unsuitable for bias detection, while fine-tuned BERT models generally perform well across all evaluated metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。