用模块化整数向量实现高效高维计算,兼顾精度与硬件效率。
Efficient Hyperdimensional Computing with Modular Composite Representations
- 用模运算的整数向量表示信息,提升表达能力同时降低资源开销。
- 在123个数据集上表现优于二值向量,内存仅需二值散射码1/4即可达同等精度。
- 专用加速器实现速度提升300倍、能耗降低2.68倍,适合边缘计算场景。
模块化复合表示(MCR)是一种基于模运算的高维整数向量计算模型,可提升信息表达能力且无需高精度组件。尽管具有潜力,但其复杂性常被认为超过收益。本文首次系统评估MCR,发现其在容量、准确率和硬件效率间取得独特平衡。实验表明,MCR在容量上优于二值与整数向量,接近复数表示但内存仅为后者的几分之一。在123个数据集上的测试显示,其准确率持续提升,并可在使用不超过4倍内存的情况下匹配二值散射码性能。通过数字逻辑映射设计了首个专用加速器,在基础操作与7个数据集上实现最高达3个数量级的速度提升及显著能效降低。当精度相当,相较二值散射码平均快3.08倍、能耗低2.68倍。这表明,虽运算更复杂,但模运算与更高每分量精度使维度更低,结合专用硬件后成为更快、更节能、更高精度的替代方案。
原文摘要 · Abstract (English)
The modular composite representation (MCR) is a computing model that represents information with high-dimensional integer vectors using modular arithmetic. Originally proposed as a generalization of the binary spatter code model, it aims to provide higher representational power while remaining a lighter alternative to models requiring high-precision components. Despite this potential, MCR has received limited attention. Systematic analyses of its trade-offs and comparisons with other models are lacking, sustaining the perception that its added complexity outweighs the improved expressivity. In this work, we revisit MCR by presenting its first extensive evaluation, demonstrating that it achieves a unique balance of capacity, accuracy, and hardware efficiency. Experiments measuring capacity demonstrate that MCR outperforms binary and integer vectors while approaching complex-valued representations at a fraction of their memory footprint. Evaluation on 123 datasets confirms consistent accuracy gains and shows that MCR can match the performance of binary spatter codes using up to 4x less memory. We investigate the hardware realization of MCR by showing that it maps naturally to digital logic and by designing the first dedicated accelerator. Evaluations on basic operations and 7 selected datasets demonstrate a speedup of up to 3 orders of magnitude and significant energy reductions compared to software implementation. When matched for accuracy against binary spatter codes, MCR achieves on average 3.08x faster execution and 2.68x lower energy consumption. These findings demonstrate that, although MCR requires more sophisticated operations than binary spatter codes, its modular arithmetic and higher per-component precision enable lower dimensionality. When realized with dedicated hardware, this results in a faster, more energy-efficient, and high-precision alternative to existing models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。