用强化学习+注意力机制,让实时调度更准更快。
TempoNet: Slack-Quantized Transformer-Guided Reinforcement Scheduler for Adaptive Deadline-Centric Real-Time Dispatchs
- 用变换器+深度Q网络做调度决策,支持无序任务全局推理。
- 在多处理器上实现近线性扩展,推理时间低于1毫秒。
- 适合高吞吐实时系统,尤其对截止期限敏感的工业场景。
实时调度器需在严格计算预算下处理紧致截止期限。本文提出TempoNet,一种将排列不变变换器与深度Q逼近相结合的强化学习调度器。紧急度分词器将时间松弛离散化为可学习嵌入,稳定值学习并捕捉截止期限临近程度。具有延迟感知的稀疏注意力堆栈采用块级Top-k选择与局部敏感分块,实现对无序任务集的全局推理,具备近线性扩展性与亚毫秒级推理速度。多核映射层通过掩码贪心选择或可微匹配,将上下文化的Q值转化为处理器分配。在工业级混合关键性负载和大规模多处理器设置上的评估显示,其在截止期限满足率上持续优于分析型调度器与神经基线,且优化稳定性更高。诊断包括松弛量化敏感性分析、注意力驱动的策略解释、软硬件联合测试与内核微基准测试,以及在压力下的鲁棒性验证;还报告了行为克隆预训练带来的样本效率提升,并证实与演员-评论家变体兼容而无需修改推理流程。这些结果建立了一个面向高吞吐实时调度的实用化基于变换器的决策框架。
原文摘要 · Abstract (English)
Real-time schedulers must reason about tight deadlines under strict compute budgets. We present TempoNet, a reinforcement learning scheduler that pairs a permutation-invariant Transformer with a deep Q-approximation. An Urgency Tokenizer discretizes temporal slack into learnable embeddings, stabilizing value learning and capturing deadline proximity. A latency-aware sparse attention stack with blockwise top-k selection and locality-sensitive chunking enables global reasoning over unordered task sets with near-linear scaling and sub-millisecond inference. A multicore mapping layer converts contextualized Q-scores into processor assignments through masked-greedy selection or differentiable matching. Extensive evaluations on industrial mixed-criticality traces and large multiprocessor settings show consistent gains in deadline fulfillment over analytic schedulers and neural baselines, together with improved optimization stability. Diagnostics include sensitivity analyses for slack quantization, attention-driven policy interpretation, hardware-in-the-loop and kernel micro-benchmarks, and robustness under stress with simple runtime mitigations; we also report sample-efficiency benefits from behavioral-cloning pretraining and compatibility with an actor-critic variant without altering the inference pipeline. These results establish a practical framework for Transformer-based decision making in high-throughput real-time scheduling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。