arXiv:2501.01841cs.CVcs.AR2025-01CVPR被引 1

轻量化实例分割模型与专用硬件加速器,大幅降低嵌入式系统计算开销。

Dedicated Inference Engine and Binary-Weight Neural Networks for Lightweight Instance Segmentation

  • 用位运算替代乘法,简化二值权重网络的计算
  • 硬件成本仅需同类方案52%,在人检测任务上精度更高
  • 适合资源受限的嵌入式视觉应用,如移动端或边缘设备

降低计算开销是嵌入式系统发展的关键问题。本文提出一种针对现代二值权重神经网络(BNNs)的专用推理引擎硬件设计方法,支持两种运行模式。通过将乘累加(MAC)操作替换为位运算,显著减少硬件资源消耗。该架构在实现BNN推理时,硬件成本仅为相关工作52%。同时,提出两个轻量级网络,结合SegNeXt骨干和SparseInst解码器用于实例分割,其输出仅需位运算与加法计算。实验表明,所提推理引擎可高效处理上述网络,在人检测类别上精度高于YOLACT,且模型尺寸仅为后者的77.7倍小。

原文摘要 · Abstract (English)

Reducing computational costs is an important issue for development of embedded systems. Binary-weight Neural Networks (BNNs), in which weights are binarized and activations are quantized, are employed to reduce computational costs of various kinds of applications. In this paper, a design methodology of hardware architecture for inference engines is proposed to handle modern BNNs with two operation modes. Multiply-Accumulate (MAC) operations can be simplified by replacing multiply operations with bitwise operations. The proposed method can effectively reduce the gate count of inference engines by removing a part of computational costs from the hardware system. The architecture of MAC operations can calculate the inference results of BNNs efficiently with only 52% of hardware costs compared with the related works. To show that the inference engine can handle practical applications, two lightweight networks which combine the backbones of SegNeXt and the decoder of SparseInst for instance segmentation are also proposed. The output results of the lightweight networks are computed using only bitwise operations and add operations. The proposed inference engine has lower hardware costs than related works. The experimental results show that the proposed inference engine can handle the proposed instance-segmentation networks and achieves higher accuracy than YOLACT on the "Person" category although the model size is 77.7$\times$ smaller compared with YOLACT.

轻量化实例分割二值网络硬件加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。