arXiv:2501.00129cs.CLcs.AI2025-01被引 1

针对儿童焦虑检测文本数据中的性别偏见,提出数据驱动的去偏方法。

A Data-Centric Approach to Detecting and Mitigating Demographic Bias in Pediatric Mental Health Text: A Case Study in Anxiety Detection

  • 通过分析临床文本的语言差异,识别性别相关偏见来源。
  • 女性患者误诊率高9%,模型准确率低4%,源于文本信息密度差异。
  • 去偏后诊断公平性提升27%,适合医疗AI公平性研究者参考。

医疗AI模型常继承训练数据中的偏见。尽管结构化数据的偏见已有研究,但精神健康依赖大量非结构化文本数据。本研究聚焦儿科心理健康筛查中基于文本的AI模型,旨在检测并缓解非生物因素导致的语言差异。目标包括:(1) 评估不同性别子群体的预测公平性;(2) 通过文本分布分析识别偏见来源;(3) 提出一种去偏方法。研究发现,女性青少年患者的焦虑检测准确率比男性低4%,假阴性率高出9%,可能源于病历文本平均长度差500词及语言分布差异。采用数据驱动的去偏方法后,诊断偏差降低最多达27%,显著提升了跨群体公平性。该方法通过中性化偏见词汇并保留关键临床信息,为文本类医疗AI的公平性优化提供了有效路径。

原文摘要 · Abstract (English)

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate linguistic differences related to non-biological differences in the training data of AI models designed to assist in pediatric mental health screening. Our objectives are: (1) to assess the presence of bias by evaluating outcome parity across sex subgroups, (2) to identify bias sources through textual distribution analysis, and (3) to develop a de-biasing method for mental health text data. Methods: We examined classification parity across demographic groups and assessed how gendered language influences model predictions. A data-centric de-biasing method was applied, focusing on neutralizing biased terms while retaining salient clinical information. This methodology was tested on a model for automatic anxiety detection in pediatric patients. Results: Our findings revealed a systematic under-diagnosis of female adolescent patients, with a 4% lower accuracy and a 9% higher False Negative Rate (FNR) compared to male patients, likely due to disparities in information density and linguistic differences in patient notes. Notes for male patients were on average 500 words longer, and linguistic similarity metrics indicated distinct word distributions between genders. Implementing our de-biasing approach reduced diagnostic bias by up to 27%, demonstrating its effectiveness in enhancing equity across demographic groups. Discussion: We developed a data-centric de-biasing framework to address gender-based content disparities within clinical text. By neutralizing biased language and enhancing focus on clinically essential information, our approach demonstrates an effective strategy for mitigating bias in AI healthcare models trained on text.

医疗AI文本偏见去偏方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。