arXiv:2607.15421cs.LGcs.CV2026-07

让小模型既快又可解释,还能稳定输出可信原因。

qZACH-ViT: Quantization-Aware Intrinsic Explanations with Recursive Attribution-Stabilized Optimization

论文配图:qZACH-ViT: Quantization-Aware Intrinsic Explanations with Recursive Attribution-Stabilized Optimization
图 1 · 摘自论文原文
  • 用递归归因稳定优化,让解释与预测同步一致。
  • 压缩后模型准确率比原版平均高0.0368,99.97%预测一致。
  • 适合医疗图像小模型部署,需兼顾速度与解释性的人看。

紧凑的医学图像分类器需要效率和可解释性证据,但二者常被分开处理。本文提出qZACH-ViT,是零标记、无位置信息的ZACH-ViT骨干网络的量化感知扩展,支持递归的像素级类别证据生成。引入递归归因稳定优化(RASO),通过归一化匹配分类与归因梯度,并移除与分类冲突的归因成分。在七个MedMNIST数据集上评估四种控制条件,每类50张训练图,十次固定随机种子,共完成280次实验。所有210个qZACH-ViT检查点转换为包含16个有符号INT8 MatMulInteger投影与INT32累加的混合精度ONNX INT8图。部署后的混合精度INT8 qZACH-ViT使用Adam优化,在全部七组数据上均优于FP32 ZACH-ViT基线,平均配对提升0.0313(特定数据集主指标);采用RASO的qZACH-ViT平均提升0.0368。在964,920次源模型到INT8测试对比中,预测一致性达99.9751%,主指标均值变化仅0.000133,最大为0.004386。3,600组匹配的内在归因图中,余弦相似度均值0.999955,秩相关均值0.9944,前10%重叠率0.9692。ONNX文件体积比源检查点缩小70.0%,在单/四线程下分别实现1.41×和2.39×的端到端CPU加速。RASO显著降低充分性误差并提升输入噪声稳定性,优于相同归因损失下的Adam,但未全面超越所有可解释人工智能(XAI)指标。结果表明qZACH-ViT是一种可部署的紧凑内在可解释模型,RASO是一种面向稳定性的针对性优化方法。

原文摘要 · Abstract (English)

Compact medical-image classifiers need efficiency and interpretable evidence, yet these goals are often addressed separately. We introduce qZACH-ViT, a quantization-aware extension of the zero-token (CLS-token-free), position-free ZACH-ViT backbone with recursive intrinsic patch-level class evidence. We also introduce Recursive Attribution-Stabilized Optimization (RASO), which norm-matches classification and attribution gradients and removes attribution components that conflict with classification. We evaluate four controlled conditions on seven MedMNIST datasets using 50 training images per class and ten fixed seeds, completing 280 runs. All 210 qZACH-ViT checkpoints are converted to executable mixed-precision ONNX INT8 graphs containing 16 signed INT8 MatMulInteger projections with INT32 accumulation. Deployed mixed-precision INT8 qZACH-ViT with Adam improves the FP32 ZACH-ViT baseline mean on all seven datasets, with a mean paired gain of 0.0313 in the dataset-specific primary metric; qZACH-ViT with RASO yields a mean gain of 0.0368. Across 964,920 source-to-INT8 test comparisons, prediction agreement is 99.9751\%, with a mean absolute primary-metric change of 0.000133 and a maximum of 0.004386. Across 3,600 matched intrinsic maps, mean cosine similarity is 0.999955, mean rank correlation is 0.9944, and mean top-10\% overlap is 0.9692. ONNX artifacts are 70.0\% smaller than source checkpoints and provide $1.41\times$ and $2.39\times$ end-to-end CPU speedups with one and four threads. RASO significantly reduces sufficiency error and improves input-noise stability over Adam with the same attribution loss, but does not dominate every predictive or explainable artificial intelligence (XAI) metric. These results establish qZACH-ViT as a deployable compact intrinsically explainable model and RASO as a targeted stability-oriented optimization procedure.

医疗图像模型压缩可解释性量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。