构建可扩展的公平性预处理评估框架,助力数据级算法公平性研究
Revisiting Pre-processing Group Fairness: A Modular Benchmarking Framework
- 基于AIF360平台设计模块化框架,支持数据、干预方法与模型无缝集成
- 提供批处理接口与自动报告功能,实现公平性与效用指标高效评估
- 填补数据级公平性评测空白,适合从事算法公平性研究的开发者使用
随着机器学习系统在高风险决策中的广泛应用,算法结果的公平性成为关键问题。现有缓解偏差的方法主要分为预处理、在处理和后处理三类,其中预处理方法作用于数据层面,具备模型无关性和更好的隐私合规优势,但长期缺乏标准化评估工具。本文提出FairPrep,一个基于AIF360的可扩展模块化基准测试框架,用于评估表格数据上的公平性感知预处理技术。该框架支持数据集、公平性干预方法与预测模型的便捷集成,提供批处理接口,实现高效实验与公平性及效用指标的自动报告。通过标准化流程与可复现评估,FairPrep弥补了公平性评测领域的关键缺口,为推进数据级公平性研究提供了实用基础。
原文摘要 · Abstract (English)
As machine learning systems become increasingly integrated into high-stakes decision-making processes, ensuring fairness in algorithmic outcomes has become a critical concern. Methods to mitigate bias typically fall into three categories: pre-processing, in-processing, and post-processing. While significant attention has been devoted to the latter two, pre-processing methods, which operate at the data level and offer advantages such as model-agnosticism and improved privacy compliance, have received comparatively less focus and lack standardised evaluation tools. In this work, we introduce FairPrep, an extensible and modular benchmarking framework designed to evaluate fairness-aware pre-processing techniques on tabular datasets. Built on the AIF360 platform, FairPrep allows seamless integration of datasets, fairness interventions, and predictive models. It features a batch-processing interface that enables efficient experimentation and automatic reporting of fairness and utility metrics. By offering standardised pipelines and supporting reproducible evaluations, FairPrep fills a critical gap in the fairness benchmarking landscape and provides a practical foundation for advancing data-level fairness research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。