首个面向流程监控的持续学习微调框架,解决冷启动难题。
Efficient Online Continual Foundation Model Fine-Tuning for Predictive Process Monitoring

- 基于自适应子空间动态识别任务边界,实现在线持续微调。
- 在九个数据流上超越三类主流方法,尤其擅长处理周期性漂移。
- 适合需要长期部署的工业流程监控系统使用。
预测式流程监控(PPM)模型被广泛应用于动态环境,其中概念漂移导致底层过程分布随时间变化。尽管近期研究转向在线持续学习,但现有方法仍从零开始训练紧凑的任务特定网络,存在持续的冷启动问题。基础模型(FMs)为该问题提供可行解决方案,但在流程挖掘领域的持续微调尚未被探索。本文提出COMPASS(Continual Online foundation Model-based PPM with Adaptive SubSpaces),首个面向PPM的在线持续微调基础模型框架。COMPASS将损失平台漂移检测机制引入事件流,自动识别任务边界,并维护一个包含预训练与任务特异性方向的统一知识子空间。我们在涵盖合成与真实世界概念漂移场景的九个事件流上进行评估,覆盖无任务信息与有任务信息两种设置,采用多种骨干网络并保持一致超参数调优。结果表明,该方法优于三种SOTA非基础模型竞争者及两类更新策略基线,在呈现周期性漂移与复杂长时案例的数据流上表现尤为突出,同时计算开销相比非基础模型方法可接受。
原文摘要 · Abstract (English)
Predictive Process Monitoring (PPM) models are increasingly deployed in dynamic environments where concept drift causes the underlying process distribution to shift over time. While recent work has moved toward online continual learning, existing methods train compact, task-specific networks entirely from scratch, leaving a persistent cold-start problem. Foundation Models (FMs) offer a compelling solution to this problem, but their continual fine-tuning in the process mining domain remains unexplored. We propose COMPASS (Continual Online foundation Model-based PPM with Adaptive SubSpaces), the first framework for online continual fine-tuning of FMs for PPM. COMPASS adapts loss-plateau drift detection to autonomously identify task boundaries in event streams and maintains a unified knowledge subspace including both pre-trained and task-specific directions. We evaluate our approach on nine event streams covering synthetic and real-world concept drift scenarios, across task-free and task-aware settings with multiple backbones and with consistent hyperparameter tuning across all methods. Our approach outperforms three SOTA non-FM competitors and two update strategy baselines, with particularly strong gains on streams exhibiting recurrent drift and complex, long-running cases, while incurring acceptable computational overhead compared to the non-FM competitors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。