arXiv:2608.28236cs.LG2026-08

用大模型联合预测流程下一步和剩余时间,提升在困难场景下的准确性。

D-TAIA: Domain-Aware LLM Adaptation for Multi-Task Predictive Process Monitoring

论文配图:D-TAIA: Domain-Aware LLM Adaptation for Multi-Task Predictive Process Monitoring
图 1 · 摘自论文原文
  • 基于领域感知三元组损失与近邻检索,实现高效多任务适配。
  • 在四个真实数据集上达到或超越当前最佳性能,尤其在高熵场景表现优异。
  • 仅需1000万参数微调,适合资源有限但需高精度的工业流程监控。

预测性流程监控(PPM)使组织能够预测未来流程行为,如下一个活动及正在进行案例的剩余时间。现实中,数据稀缺、高流程熵和分布偏移三种情况导致现有方法性能下降。尽管基础模型(特别是大语言模型,LLMs)通过广泛的序列推理提供了新范式,但在这些条件下将它们适配到多任务PPM仍面临挑战。现有基于模型的方法要么缺乏处理分布偏移的机制,要么依赖与连续时间预测任务结构不匹配的直接回归头。本文提出D-TAIA(领域感知训练与注意力推理架构),通过参数高效微调基础模型骨干,实现联合下一活动与剩余时间预测。该方法结合领域感知三元组损失(DATL)预训练与基于FAISS的最近邻检索进行剩余时间预测,并采用TAIA推理策略,在微调过程中保持预训练的序列推理能力。在四个真实事件日志上的评估显示,相比微调后的LLM和循环神经网络基线,D-TAIA始终表现达到或优于当前最优。消融研究证实,来自NLP和计算机视觉的技术可有效迁移至PPM,仅需1000万参数骨干,但各组件贡献随数据集熵值变化而异。

原文摘要 · Abstract (English)

Predictive Process Monitoring (PPM) enables organizations to forecast future process behavior, such as the next activity and remaining time of ongoing cases. In practice, three conditions cause existing methods to degrade, namely data scarcity, high process entropy and distributional shift. While Foundation Models (FMs), especially Large Language Models (LLMs), offer a new paradigm through broad sequential reasoning, adapting them to multi-task PPM under these conditions remains an open challenge. Existing FM-based approaches either lack mechanisms for handling distributional shift or rely on direct regression heads that can be structurally misaligned with continuous time prediction tasks. This paper introduces D-TAIA (Domain-aware Training and Attention-based Inference Architecture), a framework for a joint next activity and remaining time prediction task via parameter-efficient fine-tuning of an FM backbone. Our approach combines domain-aware triplet loss (DATL) pre-training with FAISS-based nearest neighbor retrieval for remaining time prediction, and adopts the TAIA inference strategy to preserve pre-trained sequential reasoning during fine-tuning. Evaluated across four real-world event logs, D-TAIA consistently shows SOTA or competitive performance compared to a fine-tuned LLM and a recurrent neural network baseline. Ablation studies confirm that techniques from NLP and computer vision can be transferred effectively to PPM with only a 10M-parameter backbone, though component contributions vary by dataset entropy.

流程监控大模型应用多任务学习参数效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。