用伯恩斯坦多项式实现高精度神经网络的可解释边缘部署
Bern2Edge: A Neurosymbolic Compiler for Edge Deployment via Bernstein Polynomial Networks

- 将预训练模型转为伯恩斯坦多项式激活,支持软硬件协同优化
- 在相同压缩率下比ReLU高2.12个百分点准确率,延迟降低99.8%
- 提供可解释规则路径,适合对可靠性要求高的边缘场景
在资源受限的边缘设备上部署高精度神经网络仍具挑战性,现有方法将训练、压缩与硬件合成分阶段处理,导致软件模型与高效部署之间存在差距,且缺乏可解释性支持。本文提出Bern2Edge,一种端到端框架,通过知识蒸馏将预训练前馈网络转化为基于伯恩斯坦多项式激活的硬件高效表示。该表示支持两种部署路径:(i) 高保真查表法实现,在压缩下保持模型精度;(ii) 基于伯恩斯坦激活几何结构的符号规则表示,实现可解释推理并显式约束输入空间。所得伯恩斯坦神经网络在相同压缩约束下相比ReLU提升最高2.12百分点准确率。系统层面,相较于W8A8量化教师模型,Bern2Edge在AMD Xilinx KV260 FPGA上实现最高99.8%延迟降低和95.2% BRAM减少,同时保持误差小于0.5百分点,并成功部署于低功耗Spartan-7 XC7S15 FPGA。规则路径使DSP使用量最多降低89.0%,代价为总准确率下降1.5百分点。
原文摘要 · Abstract (English)
Deploying high-accuracy neural networks on resource-constrained edge devices remains challenging, as existing approaches treat training, compression, and hardware synthesis as separate stages, leaving a gap between software-trained models and efficient end-to-end deployment with limited support for interpretability. We propose Bern2Edge, an end-to-end framework that uses knowledge distillation to convert a pretrained teacher feed-forward network into hardware-efficient representations via Bernstein polynomial activations. This representation enables two deployment paths: (i) a high-fidelity LUT-based realization that preserves model fidelity under compression, and (ii) a symbolic rule-based representation derived from Bernstein activation geometry, enabling interpretable inference with explicit input-space constraints. The resulting BNNs achieve up to 2.12 percentage-point (pp) accuracy improvement over ReLU under identical compression constraints. At the system level, Bern2Edge achieves up to 99.8% latency reduction and 95.2% BRAM reduction relative to a W8A8 quantized teacher on an AMD Xilinx KV260 FPGA, while maintaining accuracy within 0.5 pp, and further deploys on a low-power Spartan-7 XC7S15 FPGA. The rule-based path reduces DSP usage by up to 89.0% at a cost of 1.5 pp in total accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。