arXiv:2503.07313stat.MLcs.LG2025-03被引 1

研究缺失数据机制与处理方式对算法公平性的影响。

The influence of missing data mechanisms and simple missing data handling techniques on fairness

  • 在三个公开数据集上模拟三种缺失机制生成缺失值。
  • 删除法比插补法更公平,随机森林表现最优。
  • 处理方法与算法的交互作用显著,适合公平性研究者参考。

机器学习算法已深度融入日常生活,其公平性在部署前至关重要。数据缺失是偏见的重要来源之一,但现实中缺失倾向常与个体人口统计特征相关,而现有研究对缺失值及其处理方式如何影响算法公平性关注不足。多数研究仅采用简单处理方法(如删除或均值/众数填补),而较少使用多重插补等高级方法。本研究在三个用于分类公平性分析的流行数据集上,通过三种缺失机制生成高比例缺失值,评估多种缺失数据处理策略对分类算法公平性的影响。结果显示:缺失机制本身对公平性影响不显著;在各类处理方法中,列表删除法平均公平性最高;在各类算法中,随机森林平均公平性最佳。此外,处理方法与分类算法之间的交互效应也普遍存在。

原文摘要 · Abstract (English)

Machine learning algorithms permeate the day-to-day aspects of our lives and therefore studying the fairness of these algorithms before implementation is crucial. One way in which bias can manifest in a dataset is through missing values. Missing data are often assumed to be missing completely randomly; in reality the propensity of data being missing is often tied to the demographic characteristics of individuals. There is limited research into how missing values and the handling thereof can impact the fairness of an algorithm. Most researchers either apply listwise deletion or tend to use simpler methods of imputation (e.g. mean or mode) compared to more advanced approaches (e.g. multiple imputation). This study considers the fairness of various classification algorithms after a range of missing data handling strategies is applied. Missing values are generated (i.e. amputed) in three popular datasets for classification fairness, by creating a high percentage of missing values using three missing data mechanisms. The results show that the missing data mechanism does not significantly impact fairness; across the missing data handling techniques listwise deletion gives the highest fairness on average and amongst the classification algorithms random forests leads to the highest fairness on average. The interaction effect of the missing data handling technique and the classification algorithm is also often significant.

公平性缺失数据随机森林算法评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。