发现延迟检测难的根源:模型对大延迟案例预测不准,因不确定性更高。
Mind the Long Tail: Understanding the Difficulty of Delay Detection in Business Processes

- 分析14个业务日志,发现延迟时间右偏严重,多数案例延迟小
- 现有模型能准确预测常规延迟,但对大延迟案例误差显著上升
- 提出利用预测不确定性提升延迟识别效果,适合关注服务质量的团队
早期发现业务流程中的延迟案例对组织至关重要。预测性流程监控(PPM)通过历史事件日志预测正在进行案例的剩余时间,从而实现及时干预,避免超时与服务等级违规。尽管深度学习使剩余时间预测取得进展,但延迟检测本身的内在难度仍不明确。由于评估通常依赖聚合指标,以往研究难以揭示模型在目标分布各部分的表现,尤其对延迟较大的关键案例。本文基于14个事件日志分析延迟检测的困难性。结果显示,剩余时间普遍高度右偏,仅少数案例存在大延迟;现有模型虽能较好捕捉分布众数,但在高延迟案例上表现差。进一步发现明显异方差性:预测不确定性随延迟增大而升高。我们测试了缓解不平衡的方法,但收益有限,表明问题或非不平衡本身,而是延迟案例伴随更高不确定性。我们证明该相关性可被利用以显著提升延迟案例识别能力。整体而言,本工作揭示了延迟检测困难的来源,并指出不确定性感知建模是未来PPM研究的有前景方向。
原文摘要 · Abstract (English)
The early detection of delayed cases in business processes is a critical capability for organizations. Predictive process monitoring (PPM) supports this task by using historical event logs to predict the remaining time of ongoing cases, enabling timely interventions to avoid missed deadlines and service level violations. Although remaining time prediction has advanced considerably through sophisticated deep learning architectures, little is known about the intrinsic difficulty of delay detection itself. Since performance is typically assessed using aggregate metrics, prior work provides limited insight into how models perform across the target distribution, especially on the operationally most critical cases with large delays. In this paper, we address this gap by analyzing the difficulty of delay detection. Across 14 event logs, we show that remaining times are typically strongly right-skewed, with only a small fraction of cases exhibiting large delays. Existing models capture the mode of this distribution well but perform poorly on high-delay cases. We further uncover pronounced heteroscedasticity, showing that predictive uncertainty increases with delay magnitude. Based on these findings, we evaluate approaches to mitigate the imbalance problem, but find only limited benefits, suggesting that the key underlying problem may not be imbalance but higher uncertainty associated with delayed cases. We show that this correlation can be exploited to substantially improve the identification of delayed cases. Overall, our work provides new insights into the sources of difficulty in delay detection and identifies uncertainty-aware modeling as a promising direction for future PPM research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。