用经典算法实现量子启发的稀疏神经网络筛选,速度提升显著。
Winning Lottery Tickets in Neural Networks via a Quantum-Inspired Classical Algorithm
- 基于岭变换概率分布采样,构建稀疏子网络
- 运行时间降至多项式级,比传统方法快指数级
- 无需量子硬件,适合实际部署的模型压缩场景
量子机器学习旨在利用量子计算加速机器学习任务。先前工作提出一种量子算法,通过岭变换定义的优化概率分布对大型浅层神经网络中的隐藏节点进行采样,从而构造稀疏子网络。该量子算法在数据维度D下耗时O(D),而传统经典实现需处理指数级候选节点,耗时exp[O(D)]。本文提出并分析了一种量子启发的完全经典算法,实现相同采样任务,运行时间降至O(poly(D)),消除了经典方法对D的指数依赖。数值模拟显示,该采样器的实证风险接近精确采样结果,远低于均匀分布采样,且相比传统经典实现具有指数级提速。这些去量子化成果表明,稀疏子网络选择可通过经典计算机以多项式维度复杂度完成,无需量子硬件,为现有量子算法提供了替代方案。
原文摘要 · Abstract (English)
Quantum machine learning (QML) aims to accelerate machine learning tasks by exploiting quantum computation. Previous work studied a QML algorithm for selecting sparse subnetworks from large shallow neural networks. Instead of directly solving an optimization problem over a large-scale network, this algorithm constructs a sparse subnetwork by sampling hidden nodes from an optimized probability distribution defined using the ridgelet transform. The quantum algorithm performs this sampling in time $O(D)$ in the data dimension $D$, whereas a naive classical implementation relies on handling exponentially many candidate nodes and hence takes $\exp[O(D)]$ time. In this work, we construct and analyze a quantum-inspired fully classical algorithm for the same sampling task. We show that our algorithm runs in time $O(\operatorname{poly}(D))$, thereby removing the exponential dependence on $D$ from the previous classical approach. Numerical simulations show that the proposed sampler achieves empirical risk comparable to exact sampling from the optimized distribution and substantially lower than sampling from the non-optimized uniform distribution, while also exhibiting exponentially improved runtime scaling compared with the conventional classical implementation. These successful dequantization results show that sparse subnetwork selection via optimized sampling can be achieved classically with polynomial data-dimension scaling on conventional computers without quantum hardware, providing an alternative to the existing quantum algorithm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。