用内容寻址内存优化树模型推理,大幅降低资源占用。
RETENTION: Resource-Efficient Tree-Based Ensemble Model Acceleration with Content-Addressable Memory
- 提出迭代剪枝算法,专为随机森林等集成模型设计。
- 仅用原内存1/21至1/4.35,准确率损失小于3%。
- 适合需低功耗部署树模型的边缘设备开发者。
尽管深度学习在非结构化数据上表现优异,但现代树模型在处理结构化数据时仍具优势。现有加速方案难以适配树模型特性,尤其在内容寻址内存(CAM)使用中存在内存浪费和利用率低的问题。本文提出RETENTION框架,通过一种针对集成模型的新型剪枝准则,有效降低模型复杂度并控制精度损失。同时设计树映射策略,结合两项创新的数据布局方法,缓解因大量‘无关’状态导致的内存冗余。实验表明,仅应用树映射即实现CAM容量降低1.46×至21.30×;完整RETENTION框架下,容量需求减少4.35×至207.12×,且准确率下降不足3%。结果证明其在降低资源消耗方面极为高效,为树模型加速提供了高资源效率的新路径。
原文摘要 · Abstract (English)
Although deep learning has demonstrated remarkable capability in learning from unstructured data, modern tree-based ensemble models remain superior in extracting relevant information and learning from structured datasets. While several efforts have been made to accelerate tree-based models, the inherent characteristics of the models pose significant challenges for conventional accelerators. Recent research leveraging content-addressable memory (CAM) offers a promising solution for accelerating tree-based models, yet existing designs suffer from excessive memory consumption and low utilization. This work addresses these challenges by introducing RETENTION, an end-to-end framework that significantly reduces CAM capacity requirement for tree-based model inference. We propose an iterative pruning algorithm with a novel pruning criterion tailored for bagging-based models (e.g., Random Forest), which minimizes model complexity while ensuring controlled accuracy degradation. Additionally, we present a tree mapping scheme that incorporates two innovative data placement strategies to alleviate the memory redundancy caused by the widespread use of don't care states in CAM. Experimental results show that implementing the tree mapping scheme alone reduces CAM capacity requirement by $1.46\times$ to $21.30 \times$, while the full RETENTION framework achieves $4.35\times$ to $207.12\times$ reduction with less than 3\% accuracy loss. These results demonstrate that RETENTION is highly effective in minimizing CAM resource demand, providing a resource-efficient direction for tree-based model acceleration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。