arXiv:2510.09162cs.AIcs.CY2025-10被引 1

AI医生建议对不同群体存在偏见,原住民和间性人群获复杂难懂答复

Dr. Bias: Social Disparities in AI-Powered Medical Guidance

  • 用不同性别、年龄、族裔模拟患者提问,对比AI生成回答差异
  • 原住民与间性人群的医疗建议更难读、更复杂,交叉身份加剧偏差
  • 提醒公众提高AI素养,开发者亟需检测并消除系统性偏见

随着大语言模型(LLMs)快速发展,公众可便捷获得个性化健康问答服务,部分能力甚至超越专业医生。这类模型在资源匮乏地区尤其有潜力,提供广泛可及的准免费医疗支持。然而现有评估忽视医疗中的社会因素,未关注不同社会群体间的健康差距,也未检验偏见如何体现在LLM生成的医疗建议中。本文对多个临床领域的问题进行探索性分析,模拟不同性别、年龄范围和族裔的患者提问,通过比较生成回答的自然语言特征,发现当使用LLM提供医疗建议时,其输出会系统性地因用户社会属性而异。特别是原住民和间性患者获得的建议更难理解、结构更复杂。这种趋势在交叉身份群体中进一步放大。鉴于公众对这些模型的信任日益增加,我们呼吁提升公众AI素养,并要求开发者立即开展调查与干预,以减少系统性差异,防止不公正的患者支持。代码已公开于GitHub。

原文摘要 · Abstract (English)

With the rapid progress of Large Language Models (LLMs), the general public now has easy and affordable access to applications capable of answering most health-related questions in a personalized manner. These LLMs are increasingly proving to be competitive, and now even surpass professionals in some medical capabilities. They hold particular promise in low-resource settings, considering they provide the possibility of widely accessible, quasi-free healthcare support. However, evaluations that fuel these motivations highly lack insights into the social nature of healthcare, oblivious to health disparities between social groups and to how bias may translate into LLM-generated medical advice and impact users. We provide an exploratory analysis of LLM answers to a series of medical questions spanning key clinical domains, where we simulate these questions being asked by several patient profiles that vary in sex, age range, and ethnicity. By comparing natural language features of the generated responses, we show that, when LLMs are used for medical advice generation, they generate responses that systematically differ between social groups. In particular, Indigenous and intersex patients receive advice that is less readable and more complex. We observe these trends amplify when intersectional groups are considered. Considering the increasing trust individuals place in these models, we argue for higher AI literacy and for the urgent need for investigation and mitigation by AI developers to ensure these systemic differences are diminished and do not translate to unjust patient support. Our code is publicly available on GitHub.

AI医疗社会偏见大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。