arXiv:2508.12906cs.LG2025-08被引 2

用进化算法自动设计稀疏张量加速器,兼顾计算映射与稀疏策略。

SparseMap: A Sparse Tensor Accelerator Framework Based on Evolution Strategy

  • 基于进化策略联合优化张量映射与稀疏策略
  • 在 $10^{41}$ 级别设计空间中高效寻优,性能优于传统方法
  • 适合需要自动化硬件设计的机器学习系统开发者

机器学习与大数据对稀疏张量代数(SpTA)的需求增长,推动了多种稀疏张量加速器的发展。然而,现有手动设计的加速器多局限于特定场景,当场景变化时调整大量设计参数耗时且困难。因此,自动化设计稀疏张量加速器至关重要。但此前研究仅关注映射(如时空分块)或稀疏策略(跳过零元素),未能兼顾二者,导致设计不优。将映射与稀疏策略联合优化带来组合爆炸(例如 $P_{32 imes 64} imes Q_{64 imes 48} = Z_{32 imes 48}$ 工作负载下设计空间达 $O(10^{41})$),使传统优化方法(如粒子群、强化学习、蒙特卡洛树搜索)效率低下。为此,我们提出基于进化策略的稀疏张量加速器优化框架 SparseMap。SparseMap 构建涵盖映射与稀疏策略的更全面设计空间,并通过改进遗传编码与演化算子,实现对庞大多样设计空间的高效探索。定量对比显示,SparseMap 持续获得更优解。

原文摘要 · Abstract (English)

The growing demand for sparse tensor algebra (SpTA) in machine learning and big data has driven the development of various sparse tensor accelerators. However, most existing manually designed accelerators are limited to specific scenarios, and it's time-consuming and challenging to adjust a large number of design factors when scenarios change. Therefore, automating the design of SpTA accelerators is crucial. Nevertheless, previous works focus solely on either mapping (i.e., tiling communication and computation in space and time) or sparse strategy (i.e., bypassing zero elements for efficiency), leading to suboptimal designs due to the lack of comprehensive consideration of both. A unified framework that jointly optimizes both is urgently needed. However, integrating mapping and sparse strategies leads to a combinatorial explosion in the design space(e.g., as large as $O(10^{41})$ for the workload $P_{32 \times 64} \times Q_{64 \times 48} = Z_{32 \times 48}$). This vast search space renders most conventional optimization methods (e.g., particle swarm optimization, reinforcement learning and Monte Carlo tree search) inefficient. To address this challenge, we propose an evolution strategy-based sparse tensor accelerator optimization framework, called SparseMap. SparseMap constructing a more comprehensive design space with the consideration of both mapping and sparse strategy. We introduce a series of enhancements to genetic encoding and evolutionary operators, enabling SparseMap to efficiently explore the vast and diverse design space. We quantitatively compare SparseMap with prior works and classical optimization methods, demonstrating that SparseMap consistently finds superior solutions.

稀疏计算硬件优化进化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。