arXiv:2412.19340cs.LGcs.AI2024-12被引 2

用强化学习动态分配任务,降低多核芯片老化,提升可靠性。

A Reinforcement Learning-Based Task Mapping Method to Improve the Reliability of Clustered Manycores

  • 通过强化学习分三步完成任务映射,实时优化热分布。
  • 在16/32/64核系统上,平均失效时间提升最高达27%。
  • 无需离线参数计算,适合运行时动态调度场景。

多核系统规模扩大带来了可靠性与性能的双重挑战,其易受负偏压温度不稳定性(NBTI)、热载流子注入(HCI)、热循环(TC)及电迁移(EM)等老化机制影响。本文提出一种基于强化学习(RL)的任务映射方法,包含三个步骤:基于温度的聚类(使用DBSCAN)、任务到簇映射、任务到核心映射。初始阶段采用DBSCAN算法根据核心温度生成若干簇(bins),随后利用Q-learning算法完成后续映射,使各簇间热变化最小化。该方法在运行时执行,无需离线预计算参数。在SPLASH2与PARSEC基准测试套件下,对16、32和64核系统进行评估,结果表明相较现有技术,平均失效时间(MTTF)最高提升27%。

原文摘要 · Abstract (English)

The increasing scale of manycore systems poses significant challenges in managing reliability while meeting performance demands. Simultaneously, these systems become more susceptible to different aging mechanisms such as negative-bias temperature instability (NBTI), hot carrier injection (HCI), and thermal cycling (TC), as well as the electromigration (EM) phenomenon. In this paper, we propose a reinforcement learning (RL)-based task mapping method to improve the reliability of manycore systems considering the aforementioned aging mechanisms, which consists of three steps including bin packing, task-to-bin mapping, and task-to-core mapping. In the initial step, a density-based spatial application with noise (DBSCAN) clustering method is employed to compose some clusters (bins) based on the cores temperature. Then, the Q-learning algorithm is used for the two latter steps, to map the arrived task on a core such that the minimum thermal variation is occurred among all the bins. Compared to the state-of-the-art works, the proposed method is performed during runtime without requiring any parameter to be calculated offline. The effectiveness of the proposed technique is evaluated on 16, 32, and 64 cores systems using SPLASH2 and PARSEC benchmark suite applications. The results demonstrate up to 27% increase in the mean time to failure (MTTF) compared to the state-of-the-art task mapping techniques.

多核系统强化学习可靠性任务映射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。