通过人机协作识别并修正业务流程预测中的偏见,兼顾公平与准确。
A Human-In-The-Loop Approach for Improving Fairness in Predictive Business Process Monitoring
- 基于决策树蒸馏的可解释模型,结合人工判断区分公平与不公平使用敏感属性。
- 在存在混合公平/不公平使用场景下,实现公平性与准确率的较好平衡。
- 适用于医疗、金融等对公平性要求高的业务流程监控系统。
预测性流程监控使组织能够主动干预运行中的业务流程实例。给定不完整流程实例,可通过机器学习模型预测结果、下一个活动或剩余时间。尽管这些模型表现优异,但其数据驱动特性易捕获不公平、有偏或非道德的数据模式,导致基于性别、年龄等敏感属性的偏见预测。以往方法通过完全移除敏感属性来缓解偏见,但忽略了同一属性可能在某些情境下合理使用(如医疗中根据性别制定治疗方案),而在其他情境下不合理(如患者接纳不应基于性别)。本文提出一种新型、与模型无关的方法,通过人机协同方式识别并纠正预测模型中的偏见,即使敏感属性同时被公平与不公平使用。该方法基于从原始预测模型蒸馏出的决策树,通过简单修改让人工判断公平性边界。实验表明,在存在偏见数据的情况下,该方法能实现公平性与准确率的良好权衡。所有源代码和数据已公开:https://doi.org/10.5281/zenodo.15387576。
原文摘要 · Abstract (English)
Predictive process monitoring enables organizations to proactively react and intervene in running instances of a business process. Given an incomplete process instance, predictions about the outcome, next activity, or remaining time are created. This is done by powerful machine learning models, which have shown impressive predictive performance. However, the data-driven nature of these models makes them susceptible to finding unfair, biased, or unethical patterns in the data. Such patterns lead to biased predictions based on so-called sensitive attributes, such as the gender or age of process participants. Previous work has identified this problem and offered solutions that mitigate biases by removing sensitive attributes entirely from the process instance. However, sensitive attributes can be used both fairly and unfairly in the same process instance. For example, during a medical process, treatment decisions could be based on gender, while the decision to accept a patient should not be based on gender. This paper proposes a novel, model-agnostic approach for identifying and rectifying biased decisions in predictive business process monitoring models, even when the same sensitive attribute is used both fairly and unfairly. The proposed approach uses a human-in-the-loop approach to differentiate between fair and unfair decisions through simple alterations on a decision tree model distilled from the original prediction model. Our results show that the proposed approach achieves a promising tradeoff between fairness and accuracy in the presence of biased data. All source code and data are publicly available at https://doi.org/10.5281/zenodo.15387576.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。