arXiv:2605.25991cs.LGcs.NA2026-05被引 2

快速评估深度学习模型的浮点计算不确定性,提升可靠性与效率。

Fuzzy PyTorch: Rapid Numerical Variability Evaluation for Deep Learning Models

论文配图:Fuzzy PyTorch: Rapid Numerical Variability Evaluation for Deep Learning Models
图 1 · 摘自论文原文
  • 用随机舍入和新舍入模式在PyTorch中实现数值变异性分析
  • 相比现有工具,运行速度提升5到60倍,性能无损
  • 支持百万级参数模型,适合研究与工程部署

我们提出Fuzzy PyTorch,一个用于快速评估深度学习模型数值变异性的框架。随着深度学习应用于多样化任务,理解浮点运算带来的不确定性对确保模型稳健性和可靠性至关重要。现有评估工具需具备可扩展性、高效性,并能无缝集成至主流框架,同时最小化代码改动。Fuzzy PyTorch通过概率舍入与指令集管理,将随机算术集成至PyTorch,依托Verificarlo(一个数值分析编译器)实现。该库提供随机舍入模式和一种新型上-下舍入模式。对比实验表明,Fuzzy PyTorch在保持模型性能的同时,相较当前最先进的工具Verrou,运行时间减少5至60倍。我们进一步验证了其可扩展性,成功运行了参数量从100万到3.41亿不等的模型,证明其适用于从小型到大型深度学习架构的广泛场景。总体而言,Fuzzy PyTorch为评估深度学习中的数值变异性提供了高效、可扩展且实用的解决方案,使研究人员与从业者可在不牺牲性能或计算效率的前提下,量化并管理浮点不确定性。

原文摘要 · Abstract (English)

We introduce Fuzzy PyTorch, a framework for rapid evaluation of numerical variability in deep learning (DL) models. As DL is increasingly applied to diverse tasks, understanding variability from floating-point arithmetic is essential to ensure robust and reliable performance. Tools assessing such variability must be scalable, efficient, and integrate seamlessly with existing frameworks while minimizing code modifications. Fuzzy PyTorch enables this by integrating stochastic arithmetic into PyTorch through Probabilistic Rounding with Instruction Set Management, a novel library interfacing with Verificarlo, a numerical analysis compiler. The library offers stochastic rounding mode and a novel mode; up-down rounding. Comparative evaluations show Fuzzy PyTorch maintains model performance and achieves runtime reductions of 5x to 60x versus Verrou, a state-of-the-art tool. We further demonstrate scalability by running models from 1 to 341 million parameters, confirming applicability across small and large DL architectures. Overall, Fuzzy PyTorch provides an efficient, scalable, and practical solution for assessing numerical variability in deep learning, enabling researchers and practitioners to quantify and manage floating-point uncertainty without compromising performance or computational efficiency.

浮点分析深度学习模型可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。