用高维向量编码图像并加速推理,实现实时分类
Primitive-Driven Acceleration of Hyperdimensional Computing for Real-Time Image Classification
- 将图像局部区域映射为带空间信息的高维向量,通过基本操作融合成全局表示
- 在MNIST上达95.67%准确率,FPGA实现0.09ms延迟,比CPU快1300倍
- 适合需要低延迟、高能效的嵌入式视觉应用
高维计算(HDC)使用极高维度、低精度的向量(即超向量)表示数据,并通过轻量、抗噪操作完成学习与推理。然而,其高维度、稀疏性及频繁的数据移动导致传统处理器难以高效加速。因此,在CPU或GPU上执行绑定、置换、捆绑和相似性搜索等核心操作常出现利用率低下、内存瓶颈,限制实时性能。本文贡献有二:首先,提出一种图像编码算法,类似卷积神经网络,将局部图像块映射为富含空间信息的超向量,再通过基础HDC操作合并为全局表示,实现空间敏感且鲁棒的图像编码;该编码器在MNIST上达到95.67%准确率,在Fashion-MNIST上达85.14%,优于已有方法。其次,设计端到端加速器,基于流水线架构在FPGA上实现这些计算,同时利用超向量维度内与图像块间的并行性。Alveo U280实现中,推理延迟仅为0.09ms,相较最优CPU和GPU基线分别提升1300倍和60倍。
原文摘要 · Abstract (English)
Hyperdimensional Computing (HDC) represents data using extremely high-dimensional, low-precision vectors, termed hypervectors (HVs), and performs learning and inference through lightweight, noise-tolerant operations. However, the high dimensionality, sparsity, and repeated data movement involved in HDC make these computations difficult to accelerate efficiently on conventional processors. As a result, executing core HDC operations: binding, permutation, bundling, and similarity search: on CPUs or GPUs often leads to suboptimal utilization, memory bottlenecks, and limits on real-time performance. In this paper, our contributions are two-fold. First, we develop an image-encoding algorithm that, similar in spirit to convolutional neural networks, maps local image patches to hypervectors enriched with spatial information. These patch-level hypervectors are then merged into a global representation using the fundamental HDC operations, enabling spatially sensitive and robust image encoding. This encoder achieves 95.67% accuracy on MNIST and 85.14% on Fashion-MNIST, outperforming prior HDC-based image encoders. Second, we design an end-to-end accelerator that implements these compute operations on an FPGA through a pipelined architecture that exploits parallelism both across the hypervector dimensionality and across the set of image patches. Our Alveo U280 implementation delivers 0.09ms inference latency, achieving up to 1300x and 60x speedup over state-of-the-art CPU and GPU baselines, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。