arXiv:2606.14283cs.LGcs.AI2026-06中稿 · the 24th Internati…

提出可感知流程结构的损失函数,提升模型对流程行为的全局准确性。

DIFF-ERO: A Conformance-Aware Loss for Deep Learning in Process Mining

论文配图:DIFF-ERO: A Conformance-Aware Loss for Deep Learning in Process Mining
图 1 · 摘自论文原文
  • 基于熵的随机合规性构建可微分损失,融入控制流信息进行训练。
  • 在流程结构关键场景中显著提升预测性能,同时保持其他场景性能一致。
  • 适用于任意输出随机转移的模型,适合流程挖掘与预测任务。

深度学习推动了流程分析的多项进展,尤其在预测与处方监控方面。然而,标准损失如交叉熵仅优化局部下一步概率,隐式捕捉控制流结构,导致模型虽在令牌级别准确,却可能产生不精确的全局行为。本文提出 DIFF-ERO,一种面向流程数据深度学习模型的合规性感知损失函数。DIFF-ERO 是熵基随机合规性的可微分形式,训练时融入控制流信息。方法通过构建具有软边隶属度的批次级随机转移矩阵,使结构精度与召回信号直接参与反向传播。该损失与模型无关,适用于任何以随机转移参数化最终表示的场景。我们在 Transformer 编码器-解码器流水线中实现 DIFF-ERO,与交叉熵联合使用,分析其收敛特性。在对比其他损失函数与目标的基准测试中,DIFF-ERO 在结构重要场景中表现更优,同时在其他场景保持性能相当。此外,学习到的随机自动机逐渐逼近结构真值,表明网络已内化流程模型结构。

原文摘要 · Abstract (English)

Deep learning has driven many recent advances in process analytics, especially for predictive and prescriptive monitoring. However, standard objectives such as cross-entropy optimize local next-step likelihoods and only implicitly capture control-flow structure. As a result, models can achieve high token-level accuracy while permitting imprecise global behaviour. We introduce DIFF-ERO, a conformance-aware loss function for deep learning models on process data. DIFF-ERO is a differentiable formulation of entropy-based stochastic conformance that incorporates control-flow information during training. Our approach constructs batch-level stochastic transition matrices with soft edge memberships, allowing structural precision and recall signals to directly inform backpropagation. The loss is model-agnostic and can be applied whenever the final representation parametrizes stochastic transitions. We instantiate DIFF-ERO in transformer encoder-decoder pipelines for next-activity prediction and use it jointly with cross-entropy to analyse its theoretical components with respect to convergence. Across benchmarks comparing other loss functions and targets, DIFF-ERO shows improved predictive performance where structure matters most while maintaining parity elsewhere. At the same time, the learned stochastic automaton converges towards the structural ground truth, indicating that the network internalizes process model structure.

流程挖掘深度学习损失函数结构感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。