arXiv:2504.21074cs.DBcs.AI2025-04被引 13

大模型经微调后可精准理解流程语义,解决发现与异常检测难题

On the Potential of Large Language Models to Solve Semantics-Aware Process Mining Tasks

  • 通过提示学习与微调结合,提升大模型对流程语义的理解能力
  • 微调后在跨行业流程任务中表现优异,准确率显著高于默认模式
  • 适合需要理解活动含义的流程挖掘场景,如异常识别与流程发现

大语言模型在流程挖掘任务中展现出潜力。现有研究证明其能支持数据驱动的流程分析,甚至具备一定推理能力。这表明其有望解决依赖活动语义理解的任务,如流程发现(活动意义反映依赖关系)和异常检测(语义用于识别异常行为)。本文系统探索了大模型在此类任务中的能力。不同于以往仅评估默认状态,我们采用上下文学习与监督微调相结合的方法。具体定义了五类需语义理解的流程挖掘任务,并构建了全面的基准数据集。实验表明,当仅使用原始模型或少量提示时,大模型在复杂任务上表现不佳;但经微调后,其在多种流程类型与行业中均实现强性能。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown to be valuable tools for tackling process mining tasks. Existing studies report on their capability to support various data-driven process analyses and even, to some extent, that they are able to reason about how processes work. This reasoning ability suggests that there is potential for LLMs to tackle semantics-aware process mining tasks, which are tasks that rely on an understanding of the meaning of activities and their relationships. Examples of these include process discovery, where the meaning of activities can indicate their dependency, whereas in anomaly detection the meaning can be used to recognize process behavior that is abnormal. In this paper, we systematically explore the capabilities of LLMs for such tasks. Unlike prior work, which largely evaluates LLMs in their default state, we investigate their utility through both in-context learning and supervised fine-tuning. Concretely, we define five process mining tasks requiring semantic understanding and provide extensive benchmarking datasets for evaluation. Our experiments reveal that while LLMs struggle with challenging process mining tasks when used out of the box or with minimal in-context examples, they achieve strong performance when fine-tuned for these tasks across a broad range of process types and industries.

大模型流程挖掘语义理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。