arXiv:2507.12935cs.LGcs.AI2025-07

提出软硬协同框架MC²A,显著加速马尔可夫链蒙特卡洛计算。

MC$^2$A: Enabling Algorithm-Hardware Co-Design for Efficient Markov Chain Monte Carlo Acceleration

  • 通过扩展性能模型,找到计算、采样与内存的最优平衡点。
  • 设计可重构硬件架构,支持多种不规则访问的MCMC算子。
  • 引入新型Gumbel采样器,消除指数和归一化运算,提升效率。

越来越多应用采用基于采样的算法进行规划、优化和推断,其中马尔可夫链蒙特卡洛(MCMC)是机器学习新兴分支的核心计算基础。然而,高计算成本限制了其在大规模问题和真实场景中的应用,现有加速方案或缺乏硬件灵活性,或无法在端到端应用中保持系统级效率。本文提出MC²A,一种算法-硬件协同设计框架,实现MCMC加速的高效与灵活。首先,通过扩展处理器性能屋顶模型并引入第三维,分析MCMC工作负载多样性,确定计算、采样与内存参数的最优平衡。其次,设计参数化硬件加速器架构,包含可编程树状处理单元、可重构采样器与交叉开关互连,支持不规则内存访问。核心创新为新型Gumbel采样器,消除指数与归一化操作。在端到端案例研究中,相比CPU、GPU、TPU及最先进的MCMC加速器,MC²A分别获得307.6×、1.4×、2.0×、84.2×的加速比。在多个代表性MCMC工作负载上验证,证明通用硬件加速的可行性,推动基于MCMC的解决方案在多样化应用场景中的普及。

原文摘要 · Abstract (English)

An increasing number of applications are exploiting sampling-based algorithms for planning, optimization, and inference. The Markov Chain Monte Carlo (MCMC) algorithms form the computational backbone of this emerging branch of machine learning. Unfortunately, the high computational cost limits their feasibility for large-scale problems and real-world applications, and the existing MCMC acceleration solutions are either limited in hardware flexibility or fail to maintain efficiency at the system level across a variety of end-to-end applications. This paper introduces \textbf{MC$^2$A}, an algorithm-hardware co-design framework, enabling efficient and flexible optimization for MCMC acceleration. Firstly, \textbf{MC$^2$A} analyzes the MCMC workload diversity through an extension of the processor performance roofline model with a 3rd dimension to derive the optimal balance between the compute, sampling and memory parameters. Secondly, \textbf{MC$^2$A} proposes a parametrized hardware accelerator architecture with flexible and efficient support of MCMC kernels with a pipeline of ISA-programmable tree-structured processing units, reconfigurable samplers and a crossbar interconnect to support irregular access. Thirdly, the core of \textbf{MC$^2$A} is powered by a novel Gumbel sampler that eliminates exponential and normalization operations. In the end-to-end case study, \textbf{MC$^2$A} achieves an overall {$307.6\times$, $1.4\times$, $2.0\times$, $84.2\times$} speedup compared to the CPU, GPU, TPU and state-of-the-art MCMC accelerator. Evaluated on various representative MCMC workloads, this work demonstrates and exploits the feasibility of general hardware acceleration to popularize MCMC-based solutions in diverse application domains.

MCMC硬件加速软硬协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。