arXiv:2504.19933cs.AIcs.LG2025-04被引 2

用深度强化学习解决大规模动态任务分配问题,提升真实场景效率。

Automated decision-making for dynamic task assignment at scale

  • 设计图结构观测与动作空间,通用建模复杂任务流程。
  • 奖励函数等价于最小化任务平均周期时间,优化目标明确。
  • 在5个真实日志数据集上表现超越基线,跨时间与实例泛化能力强。

动态任务分配问题(DTAP)旨在实时匹配资源与任务以最小化目标,如资源成本或任务周期时间。本文研究一种变体:每个任务是由随机活动序列组成的案例,需决定由哪名员工处理哪个活动以最快完成请求。近年来,深度强化学习(DRL)被用于解决此类问题,但多数研究局限于小规模合成数据,忽视真实场景挑战。为此,本文提出基于DRL的决策支持系统(DSS),针对真实规模的DTAP。核心创新包括:采用图结构表示观测与动作,可有效建模任意DTAP;设计可证明等价于最小化任务平均周期时间的奖励函数。二者结合使代理能学习高效且可泛化的分配策略。DSS在5个基于真实日志(通过流程挖掘提取参数)的DTAP实例上评估,实验表明该DRL代理在所有实例中表现匹敌或优于最佳基线,并在不同时间跨度和实例间实现良好泛化。

原文摘要 · Abstract (English)

The Dynamic Task Assignment Problem (DTAP) concerns matching resources to tasks in real time while minimizing some objectives, like resource costs or task cycle time. In this work, we consider a DTAP variant where every task is a case composed of a stochastic sequence of activities. The DTAP, in this case, involves the decision of which employee to assign to which activity to process requests as quickly as possible. In recent years, Deep Reinforcement Learning (DRL) has emerged as a promising tool for tackling this DTAP variant, but most research is limited to solving small-scale, synthetic problems, neglecting the challenges posed by real-world use cases. To bridge this gap, this work proposes a DRL-based Decision Support System (DSS) for real-world scale DTAPS. To this end, we introduce a DRL agent with two novel elements: a graph structure for observations and actions that can effectively represent any DTAP and a reward function that is provably equivalent to the objective of minimizing the average cycle time of tasks. The combination of these two novelties allows the agent to learn effective and generalizable assignment policies for real-world scale DTAPs. The proposed DSS is evaluated on five DTAP instances whose parameters are extracted from real-world logs through process mining. The experimental evaluation shows how the proposed DRL agent matches or outperforms the best baseline in all DTAP instances and generalizes on different time horizons and across instances.

强化学习任务分配真实场景图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。