用自适应强化学习优化业务流程,实测节省31%资源、缩短23%耗时。
An Innovative Data-Driven and Adaptive Reinforcement Learning Approach for Context-Aware Prescriptive Process Monitoring
- 基于状态奖励调制的强化学习,动态生成上下文敏感的最优流程路径。
- 在真实日志上实现31%资源时间节省和23%流程时长缩减。
- 支持跨行业应用,适合需智能决策的医疗、金融等流程管理场景。
人工智能与机器学习在业务流程管理中的应用已取得显著进展,但受限于数据质量与可用性,其潜力尚未充分释放。本文提出一种名为细调离线强化学习增强流程序列优化(FORLAPS)的新框架,通过引入状态依赖的奖励塑造机制,利用强化学习识别业务流程中的最优执行路径,实现上下文感知的处方式决策。为验证有效性,我们在真实事件日志上对比了PERM(排列特征重要性)与多任务LSTM模型,结果表明,FORLAPS在资源时间上节省31%,流程时间跨度减少23%。为进一步提升学习效果,我们设计了一种面向流程的数据增强技术,通过有选择地提高采样批次中的平均估计Q值,实现强化学习模型的自动微调。鲁棒性评估采用前缀级与轨迹级分析,以达马鲁-莱文施泰因距离为主要指标。多样本案例研究涵盖医疗治疗路径、金融服务流程、监管机构许可申请及运营管理,在各领域均显著优于现有最先进方法,展现出在预测最优下一步行动方面的卓越能力。
原文摘要 · Abstract (English)
The application of artificial intelligence and machine learning in business process management has advanced significantly, however, the full potential of these technologies remains largely unexplored, primarily due to challenges related to data quality and availability. We present a novel framework called Fine-Tuned Offline Reinforcement Learning Augmented Process Sequence Optimization (FORLAPS), which aims to identify optimal execution paths in business processes by leveraging reinforcement learning enhanced with a state-dependent reward shaping mechanism, thereby enabling context-sensitive prescriptions. Additionally, to compare FORLAPS with the existing models (Permutation Feature Importance and multi-task Long Short Term Memory model), we experimented to evaluate its effectiveness in terms of resource savings and process time reduction. The experimental results on real-life event logs validate that FORLAPS achieves 31% savings in resource time spent and a 23% reduction in process time span. To further enhance learning, we introduce an innovative process-aware data augmentation technique that selectively increases the average estimated Q-values in sampled batches, enabling automatic fine-tuning of the reinforcement learning model. Robustness was assessed through both prefix-level and trace-level evaluations, using the Damerau-Levenshtein distance as the primary metric. Finally, the model's adaptability across industries was further validated through diverse case studies, including healthcare treatment pathways, financial services workflows, permit applications from regulatory bodies, and operations management. In each domain, the proposed model demonstrated exceptional performance, outperforming existing state-of-the-art approaches in prescriptive decision-making, demonstrating its capability to prescribe optimal next steps and predict the best next activities within a process trace.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。