提出可解释深度学习的流程分割方法,精准定位影响预测的关键事件段。
Feature Attribution-Based Explainability Analysis of Deep Learning Models in Predictive Process Monitoring

- 基于控制流感知的分段算法,将长流程划分为有意义片段。
- 在真实贷款与市政流程数据上验证,能准确识别影响结果的变更点。
- 适合需要透明决策过程的工业场景,如金融风控、政务审批。
预测性流程监控通过预测正在进行案例的未来状态或结果,支持运营流程的优化与控制。尽管深度神经网络在建模事件日志中的序列依赖关系方面表现优异,但其黑箱特性限制了可信度和实际应用。特征归因方法常被用于解决此问题,但直接应用存在两难:基于事件级的归因对长流程计算开销大;而基于聚合轨迹表示的解释又难以捕捉底层控制流动态。为此,我们提出一种针对深度神经网络在结果预测中的局部后处理可解释性方法。该方法依赖于一种控制流感知的分段算法,将轨迹划分为语义有意义的片段,并支持计算片段级别的SHAP解释。这使得我们能够识别哪些轨迹部分影响了预测结果,以及哪些变化点推动案例走向预测结果。我们在具有已知流程逻辑的合成数据集上评估该分段方法,其中可明确验证有意义的变化点;并在荷兰某市政机构的行政流程和贷款申请流程的真实事件日志上展示了其有效性。
原文摘要 · Abstract (English)
Predictive process monitoring supports the optimization and control of operational business processes by forecasting the future state or outcome of ongoing cases. While deep neural networks have achieved strong performance for these tasks by modeling sequential dependencies in event logs, their black-box nature limits trust and practical adoption. Feature attribution methods are often used to address this, but applying them directly poses a dilemma: event-level attributions impose high computational complexity for long traces, while explanations based on aggregated trace representations often fail to capture the underlying control-flow dynamics. To address this issue, we propose a local post-hoc explainability method for deep neural networks in outcome prediction. The method relies on a control-flow-aware segmentation algorithm that partitions a trace into meaningful segments and supports the computation of segment-level SHAP explanations. This makes it possible to identify which parts of a trace influence a prediction and which change points steer the case toward the predicted outcome. We assess the proposed segmentation method on a synthetic dataset with known process logic, where meaningful change points can be explicitly verified, and we demonstrate its usefulness on real-world event logs from a loan application process and an administrative process of a Dutch municipality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。