arXiv:2601.02455cs.SDcs.CL2026-01

提出FADE方法,实现无需训练的逐层量化补偿,提升语音识别模型压缩效果。

Diagnostic-Driven Layer-Wise Compensation for Post-Training Quantization of Encoder-Decoder ASR Models

  • 基于归一化舍入误差和启发式求解器构建每层专用补偿系数
  • 3比特下显著降低错误率,4比特性能与调优全局系数相当
  • 适用于无法做模型调优的场景,非通用替代方案

层间后训练量化会因前缀层已量化而引发输入漂移。现有全局补偿方法(QEP)使用单一系数,混淆了模型整体工作点与各层残差差异。本文提出FADE,通过归一化舍入误差与启发式校准求解器生成逐层系数,无需训练、无需模型级系数搜索,也不增加推理开销。在七个Whisper、Moonshine及Qwen3-ASR模型上,于四个英文语音识别基准测试3和4比特量化。38个设置中,31个相较固定QEP-0.5有更低平均词错误率;尽管开发集调优的全局系数可弥补大部分差距,但3比特高错误率情形下,FADE仍能有效缓解模型崩溃。在两个低错误率3比特案例中,错误率从3.67降至3.10,13.03降至11.63。4比特多数结果与调优对照组差异在可接受范围内,一处甚至反超。成对重跑与种子内置换验证显示部分结果对分配敏感,但未估算全矩阵成功率。因此FADE是无模型系数搜索时的逐层替代,非全局调优的万能替代。

原文摘要 · Abstract (English)

Layer-wise post-training quantization reconstructs each layer from inputs already altered by the quantized prefix. QEP compensates for this drift with one model-wide coefficient, conflating the model-level operating point with residual variation across layers. We present FADE, which constructs layer-specific coefficients from normalized round-to-nearest distortion and a heuristic calibrated-solver response. It requires no training or per-model coefficient search and adds no inference-time operation. We evaluate seven Whisper, Moonshine, and Qwen3-ASR models at 3 and 4 bits on four English ASR benchmarks. Across 38 settings, FADE lowers mean word error rate relative to fixed QEP-0.5 in 31, although a development-tuned global coefficient recovers much of this gap. The largest absolute reductions occur in 3-bit settings whose final error remains too high for practical use; these results measure collapse mitigation rather than deployable accuracy. In two lower-WER 3-bit cases, FADE reduces the tuned-global result from 3.67 to 3.10 and from 13.03 to 11.63. Most 4-bit differences from the tuned control are within a descriptive tolerance, and one reverses. Paired reruns and within-seed permutations on an outcome-informed subset support assignment sensitivity in selected cases, but do not estimate a matrix-wide success rate. FADE is therefore a layer-wise alternative when per-model coefficient search is unavailable, not a universal replacement for tuned global compensation.

量化语音识别编码器-解码器无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。