arXiv:2505.15391cs.LG2025-05被引 1

将决策树转为无精度损失的纯整数代码,适合低功耗设备部署。

InTreeger: An End-to-End Framework for Integer-Only Decision Tree Inference

  • 端到端生成无需浮点运算的整数决策树代码
  • 在ARM/x86/RISC-V上推理延迟显著降低
  • 适合嵌入式与边缘设备,尤其对低功耗场景友好

整数量化已成为资源受限设备部署的关键技术。尽管能降低模型复杂度,但推理性能常受量化误差影响。为此,我们提出InTreeger:一个端到端框架,输入训练数据集后输出与架构无关的纯整数C代码,实现零精度损失的树模型推理。该框架使非机器学习背景者仅需提供数据集和目标变量,即可生成可在任意硬件运行的高性能整数分类模型。我们在ARM、x86和RISC-V三种架构上评估,显著降低推理延迟,并对比典型基于浮点数的决策树实现,证明其能效优势。结果表明,纯整数推理特别适用于能量和面积受限的嵌入式系统及边缘计算平台,也支持在现有超低功耗设备上运行决策树。

原文摘要 · Abstract (English)

Integer quantization has emerged as a critical technique to facilitate deployment on resource-constrained devices. Although they do reduce the complexity of the learning models, their inference performance is often prone to quantization-induced errors. To this end, we introduce InTreeger: an end-to-end framework that takes a training dataset as input, and outputs an architecture-agnostic integer-only C implementation of tree-based machine learning model, without loss of precision. This framework enables anyone, even those without prior experience in machine learning, to generate a highly optimized integer-only classification model that can run on any hardware simply by providing an input dataset and target variable. We evaluated our generated implementations across three different architectures (ARM, x86, and RISC-V), resulting in significant improvements in inference latency. In addition, we show the energy efficiency compared to typical decision tree implementations that rely on floating-point arithmetic. The results underscore the advantages of integer-only inference, making it particularly suitable for energy- and area-constrained devices such as embedded systems and edge computing platforms, while also enabling the execution of decision trees on existing ultra-low power devices.

决策树整数量化边缘计算低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。