压缩逻辑机器实现低功耗高效推理,精度损失小。
ETHEREAL: Energy-efficient and High-throughput Inference using Compressed Tsetlin Machine
- 通过排除无关状态稀疏化逻辑模式,实现模型压缩。
- 模型规模减小87.54%,推理速度提升超10倍,能耗更低。
- 适合资源受限设备部署,尤其适用于TinyML场景。
Tsetlin Machine(TM)是一种不同于深度神经网络(DNN)的新范式,其基于命题逻辑而非多路径算术运算学习数据中的逻辑模式。在标准TM中,同一类别内的正负子句常包含相同文字,相互抵消影响。此特性可被用于构建压缩型TM模型,从而实现低功耗、高吞吐的推理。本文提出一种训练方法,通过迭代排除非关键自动机状态,稀疏化正负子句中的逻辑模式。该策略确保高度相关文字得以保留,从而维持分类精度。与标准TM相比,所提模型ETHEREAL可将模型规模减少高达87.54%,仅造成微小精度损失。我们在八组真实世界的TinyML数据集上,于STM32F746G-DISCO平台上对比了标准TM、等效随机森林(RF)和二值化神经网络(BNN)。结果表明,ETHEREAL TM在推理时间上降低超一个数量级,能耗显著下降,同时内存占用远小于RF。
原文摘要 · Abstract (English)
The Tsetlin Machine (TM) is a novel alternative to deep neural networks (DNNs). Unlike DNNs, which rely on multi-path arithmetic operations, a TM learns propositional logic patterns from data literals using Tsetlin automata. This fundamental shift from arithmetic to logic underpinning makes TM suitable for empowering new applications with low-cost implementations. In TM, literals are often included by both positive and negative clauses within the same class, canceling out their impact on individual class definitions. This property can be exploited to develop compressed TM models, enabling energy-efficient and high-throughput inferences for machine learning (ML) applications. We introduce a training approach that incorporates excluded automata states to sparsify TM logic patterns in both positive and negative clauses. This exclusion is iterative, ensuring that highly class-correlated (and therefore significant) literals are retained in the compressed inference model, ETHEREAL, to maintain strong classification accuracy. Compared to standard TMs, ETHEREAL TM models can reduce model size by up to 87.54%, with only a minor accuracy compromise. We validate the impact of this compression on eight real-world Tiny machine learning (TinyML) datasets against standard TM, equivalent Random Forest (RF) and Binarized Neural Network (BNN) on the STM32F746G-DISCO platform. Our results show that ETHEREAL TM models achieve over an order of magnitude reduction in inference time (resulting in higher throughput) and energy consumption compared to BNNs, while maintaining a significantly smaller memory footprint compared to RFs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。