arXiv:2509.03161cs.CLcs.AI2025-09被引 5

直接适配大模型处理流程数据,提升预测性能并减少调参成本。

Domain Adaptation of LLMs for Process Data

  • 不改写日志为自然语言,直接用参数高效微调适配大模型。
  • 多任务场景下性能超越RNN和叙事式方法,收敛更快。
  • 适合流程挖掘、工业预测等需要快速部署的场景。

近年来,大语言模型(LLMs)在多个研究领域崭露头角,包括流程挖掘(PM)。当前应用主要依赖提示工程或将事件日志转换为叙述性数据集,利用大模型的语义能力完成各类任务。本文则探索在不进行自然语言重构的前提下,直接将预训练大模型适配到流程数据上,基于其生成序列标记的能力与流程挖掘目标高度契合。具体采用参数高效微调技术,以缓解模型计算开销。实验聚焦于预测性流程监控(PPM),涵盖单任务与多任务预测。结果表明,在多任务设置下,该方法显著优于现有RNN模型和基于叙述风格的方法;同时,微调后的模型收敛速度更快,且对超参数调优需求显著降低。

原文摘要 · Abstract (English)

In recent years, Large Language Models (LLMs) have emerged as a prominent area of interest across various research domains, including Process Mining (PM). Current applications in PM have predominantly centered on prompt engineering strategies or the transformation of event logs into narrative-style datasets, thereby exploiting the semantic capabilities of LLMs to address diverse tasks. In contrast, this study investigates the direct adaptation of pretrained LLMs to process data without natural language reformulation, motivated by the fact that these models excel in generating sequences of tokens, similar to the objective in PM. More specifically, we focus on parameter-efficient fine-tuning techniques to mitigate the computational overhead typically associated with such models. Our experimental setup focuses on Predictive Process Monitoring (PPM), and considers both single- and multi-task predictions. The results demonstrate a potential improvement in predictive performance over state-of-the-art recurrent neural network (RNN) approaches and recent narrative-style-based solutions, particularly in the multi-task setting. Additionally, our fine-tuned models exhibit faster convergence and require significantly less hyperparameter optimization.

大模型流程挖掘参数高效预测建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。