arXiv:2607.03860cs.LG2026-07

统一量化与连续情形的强彩票票理论,给出更紧的失败概率界。

A Unified Framework for Quantized and Continuous Strong Lottery Tickets

论文配图:A Unified Framework for Quantized and Continuous Strong Lottery Tickets
图 1 · 摘自论文原文
  • 基于离散随机子集和问题分析量化网络中的稀疏子网
  • 量化场景下失败概率呈指数级降低,优于此前结果
  • 统一连续与量化情形,兼顾近似与舍入误差

强彩票票假设(SLTH)认为,充分过参数化的随机初始化神经网络中存在稀疏子网,即使未经训练也能达到小规模训练网络的性能。研究该假设的关键数学工具是随机子集和问题(RSSP)。近期,该理论被扩展至量化设置,即网络权重从离散集合中采样而非连续区间。然而,这些新结果在多个方面仍远落后于任意精度情形。本文对离散设定下的RSSP进行了分析,并据此推导出量化情形下的紧致SLTH保证。我们的分析给出了量化情形下找到强彩票票的失败概率紧界,相比之前结果实现指数级改进。更重要的是,该框架将连续情形的近似表示与量化情形的精确表示统一为极限情况,不仅收紧了已有界限,还提供了一个同时处理近似误差与舍入误差的连贯理论框架。

原文摘要 · Abstract (English)

The Strong Lottery Ticket Hypothesis (SLTH) asserts that sufficiently overparameterized, randomly initialized neural networks contain sparse subnetworks that, even without any training, can match the performance of a small trained network on a given dataset. A key mathematical tool in the theoretical study of SLTH has been the Random Subset Sum Problem (RSSP). The SLTH has recently been extended to the quantized setting, where the network weights are sampled from a discrete set rather than from a continuous interval. These new results are however far from those in arbitrary-precision setting in several ways. In this work, we provide an analysis of the RSSP in the discrete setting, and use it to derive tight SLTH guarantees in the quantized case. Our analysis obtain tight bounds on the failure probability of finding a strong lottery ticket in the quantized regime, providing an exponential improvement over previous results. Most importantly, it unifies the literature by showing that both approximate representations in the continuous setting and exact representations in quantized settings naturally emerge as limiting cases of our results. This perspective not only sharpens existing bounds but also provides a cohesive framework that simultaneously handles approximation and rounding errors.

彩票票量化神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。