让高维计算在多核CPU上实现高速推理,性能提升10倍。
ScalableHD: Scalable and High-Throughput Hyperdimensional Computing Inference on Multi-Core CPUs
- 分两阶段流水线并行处理,跨核心调度并优化缓存
- 支持大小批量任务,吞吐量最高达基线10倍
- 适合部署在无GPU的通用服务器,兼顾速度与精度
高维计算(HDC)是一种类脑计算范式,用高维向量(超向量,HV)表示和操作信息。传统HDC方法虽抗噪性强且天然并行,但依赖单次、非参数化训练,准确率较低。近期方法采用迭代训练基底和类别超向量,通常在GPU上加速。推理本身轻量,适合实时执行,但高效推理主要研究于FPGA和GPU等专用硬件,对通用多核CPU关注甚少。为此,我们提出ScalableHD,在多核CPU上实现可扩展、高吞吐的HDC推理。ScalableHD采用两阶段流水线执行模型,每阶段跨核心并行处理超向量块,中间结果通过生产者-消费者机制流式传递,实现即时消费并提升缓存局部性。为最大化性能,整合内存分块与NUMA感知的工作线程-核心绑定。此外,提供两种执行变体,分别针对小批量和大批量任务,根据负载特征挖掘计算并行性,缓解现代多核CPU上限制性能的内存瓶颈。ScalableHD在从人体动作识别到图像分类的多种任务中,相比TorchHD等先进基线,吞吐量最高提升10倍,同时保持任务准确率。且具有强可扩展性:核心数增加时,吞吐量近似成比例提升。
原文摘要 · Abstract (English)
Hyperdimensional Computing (HDC) is a brain-inspired computing paradigm that represents and manipulates information using high-dimensional vectors, called hypervectors (HV). Traditional HDC methods, while robust to noise and inherently parallel, rely on single-pass, non-parametric training and often suffer from low accuracy. To address this, recent approaches adopt iterative training of base and class HVs, typically accelerated on GPUs. Inference, however, remains lightweight and well-suited for real-time execution. Yet, efficient HDC inference has been studied almost exclusively on specialized hardware such as FPGAs and GPUs, with limited attention to general-purpose multi-core CPUs. To address this gap, we propose ScalableHD for scalable and high-throughput HDC inference on multi-core CPUs. ScalableHD employs a two-stage pipelined execution model, where each stage is parallelized across cores and processes chunks of base and class HVs. Intermediate results are streamed between stages using a producer-consumer mechanism, enabling on-the-fly consumption and improving cache locality. To maximize performance, ScalableHD integrates memory tiling and NUMA-aware worker-to-core binding. Further, it features two execution variants tailored for small and large batch sizes, each designed to exploit compute parallelism based on workload characteristics while mitigating the memory-bound compute pattern that limits HDC inference performance on modern multi-core CPUs. ScalableHD achieves up to 10x speedup in throughput (samples per second) over state-of-the-art baselines such as TorchHD, across a diverse set of tasks ranging from human activity recognition to image classification, while preserving task accuracy. Furthermore, ScalableHD exhibits robust scalability: increasing the number of cores yields near-proportional throughput improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。