arXiv:2604.19993cs.ARcs.LG2026-04中稿 · 63rd ACM/IEEE Desi…

首次实现复数神经网络的不确定性量化,并支持高效硬件部署。

Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation

论文配图:Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation
图 1 · 摘自论文原文
  • 基于丢弃法构建贝叶斯复数神经网络,实现不确定性估计。
  • 自动化搜索找到最优复数层配置,性能优于手工设计模型。
  • 定制FPGA加速器实现4.5倍以上提速,功耗低于GPU的10%。

复数神经网络(CVNNs)在处理复数任务上具有显著优势,但现有方法无法量化预测不确定性。本文首次提出基于丢弃法的贝叶斯复数神经网络(BayesCVNNs),实现复数应用中的不确定性量化,具备广泛适用性与硬件友好性。由于复数的实虚双分量特性,设计空间大幅扩展,我们引入自动化搜索方法,有效优化实部与虚部的层混合与部件混合配置。为促进部署,构建了生成定制化FPGA加速器的框架,采用一组优化的构建模块。实验表明,自动化搜索可有效找到最佳配置,在更低硬件成本下实现更高性能;优化后的加速器在不同模型上分别获得约4.5倍和13倍的加速比,功耗低于GPU实现的10%,在算法与硬件层面均优于现有工作。代码已公开于https://github.com/zehuanzhang/BayesCVNN.git。

原文摘要 · Abstract (English)

Complex-Valued Neural Networks (CVNNs) have significant advantages in handling tasks that involve complex numbers. However, existing CVNNs are unable to quantify predictive uncertainty. We propose, for the first time, dropout-based Bayesian Complex-Valued Neural Networks (BayesCVNNs) to enable uncertainty quantification for complex-valued applications, exhibiting broad applicability and efficiency for hardware implementation due to modularity. Furthermore, as the dual-part nature of complex values significantly broadens the design space and enables novel configurations based on layer-mixing and part-mixing, we introduce an automated search approach to effectively identify optimal configurations for both real and imaginary components. To facilitate deployment, we present a framework that generates customized FPGA-based accelerators for BayesCVNNs, leveraging a set of optimized building blocks. Experiments demonstrate the best configuration can be effectively found via the automated search, attaining higher performance with lower hardware costs compared with manually crafted models. The optimized accelerators achieve approximately 4.5x and 13x speedups on different models with less than 10% power consumption compared to GPU implementations, and outperform existing work in both algorithm and hardware aspects. Our code is publicly available at: https://github.com/zehuanzhang/BayesCVNN.git.

复数神经网络不确定性估计FPGA加速硬件协同设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。