皮肤癌AI模型对深色皮肤检测效果差,即使数据平衡仍存偏见。
Skin Cancer Machine Learning Model Tone Bias
- 用不平衡和平衡数据集训练模型,对比肤色检测差异。
- 无论数据是否平衡,浅色皮肤误检率均显著高于深色皮肤(偏差值0.577~0.684)。
- 提示模型偏见源于数据外因素,需新方法解决公平性问题。
背景:许多开源皮肤癌图像数据集源自以浅色皮肤为主的国家临床试验。由于肤色分布不均,基于这些数据训练的机器学习模型在浅色皮肤上表现良好,但在深色皮肤上可能效果较差,引发公平性担忧并削弱公众对AI医疗的信任。方法:我们分析了国际皮肤影像合作组织(ISIC)档案中带有肤色信息的子集,该子集存在显著肤色不平衡。为探究此问题,我们使用不平衡与平衡数据集分别训练深度卷积神经网络模型,用于分类图像为恶性或良性,并评估模型在深色与浅色皮肤间的差别影响(选择率差异)。结果:在不平衡数据集上,模型对浅色皮肤恶性图像的检测显著优于深色皮肤,产生0.577的差异影响;在平衡数据集上,差异影响仍达0.684。两者均远低于0.80的标准阈值,表明模型仍存在肤色偏见。结论:现有皮肤癌模型存在肤色偏见,而诊断或数据不平衡并非根本原因,需进一步探索其他技术来识别和纠正此类偏见。
原文摘要 · Abstract (English)
Background: Many open-source skin cancer image datasets are the result of clinical trials conducted in countries with lighter skin tones. Due to this tone imbalance, machine learning models derived from these datasets can perform well at detecting skin cancer for lighter skin tones. Any tone bias in these models could introduce fairness concerns and reduce public trust in the artificial intelligence health field. Methods: We examine a subset of images from the International Skin Imaging Collaboration (ISIC) archive that provide tone information. The subset has a significant tone imbalance. These imbalances could explain a model's tone bias. To address this, we train models using the imbalanced dataset and a balanced dataset to compare against. The datasets are used to train a deep convolutional neural network model to classify the images as malignant or benign. We then evaluate the models' disparate impact, based on selection rate, relative to dark or light skin tone. Results: Using the imbalanced dataset, we found that the model is significantly better at detecting malignant images in lighter tone resulting in a disparate impact of 0.577. Using the balanced dataset, we found that the model is also significantly better at detecting malignant images in lighter versus darker tones with a disparate impact of 0.684. Using the imbalanced or balanced dataset to train the model still results in a disparate impact well below the standard threshold of 0.80 which suggests the model is biased with respect to skin tone. Conclusion: The results show that typical skin cancer machine learning models can be tone biased. These results provide evidence that diagnosis or tone imbalance is not the cause of the bias. Other techniques will be necessary to identify and address the bias in these models, an area of future investigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。