arXiv:2508.16270cs.CL2025-08中稿 · IEEE ICPM 2025, 8 …被引 7

用指令微调让大模型理解流程语义,提升过程发现与预测能力

LLMs that Understand Processes: Instruction-tuning for Semantics-Aware Process Mining

  • 通过多任务指令对齐,让LLM掌握流程挖掘的语义理解能力
  • 在过程发现和活动预测上性能显著提升,异常检测效果因模型而异
  • 适合希望通用化流程分析、减少重复训练的研究者使用

流程挖掘正越来越多地利用事件相关的文本信息来完成异常检测和流程发现等任务。这类语义感知的流程挖掘关注的是流程中行为应有怎样的预期(即规范),为传统以频率为基础、关注实际记录行为(即现实)的技术提供了重要补充。大语言模型(LLMs)为处理语义感知任务提供了强大工具。然而,当前最佳性能仍依赖于特定任务的微调,这计算开销大,且模型仅能处理单一任务。为克服泛化性不足的问题,本文探索了指令微调在语义感知流程挖掘中的潜力。核心思路是向LLM提供多种任务的提示-答案对(如异常检测、下一活动预测),使其熟悉流程挖掘场景,从而在未见过的任务(如流程发现)上表现更优。实验表明,指令微调对流程发现和预测任务有显著提升,但在异常检测任务上的效果因模型而异,说明指令微调任务的选择对最终效果至关重要。

原文摘要 · Abstract (English)

Process mining is increasingly using textual information associated with events to tackle tasks such as anomaly detection and process discovery. Such semantics-aware process mining focuses on what behavior should be possible in a process (i.e., expectations), thus providing an important complement to traditional, frequency-based techniques that focus on recorded behavior (i.e., reality). Large Language Models (LLMs) provide a powerful means for tackling semantics-aware tasks. However, the best performance is so far achieved through task-specific fine-tuning, which is computationally intensive and results in models that can only handle one specific task. To overcome this lack of generalization, we use this paper to investigate the potential of instruction-tuning for semantics-aware process mining. The idea of instruction-tuning here is to expose an LLM to prompt-answer pairs for different tasks, e.g., anomaly detection and next-activity prediction, making it more familiar with process mining, thus allowing it to also perform better at unseen tasks, such as process discovery. Our findings demonstrate a varied impact of instruction-tuning: while performance considerably improved on process discovery and prediction tasks, it varies across models on anomaly detection tasks, highlighting that the selection of tasks for instruction-tuning is critical to achieving desired outcomes.

流程挖掘大模型指令微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。