通过内部决策模式变化,揭示深度模型泛化失败的内在机制。
Understanding Generalization through Decision Pattern Shift

- 用梯度热图构建通道贡献向量,量化样本决策模式
- 决策模式偏离程度与泛化差距高度相关(皮尔逊系数>0.8)
- 可诊断泛化风险、缺陷定位,适用于模型调试与评估
理解深度神经网络在未见样本上泛化失败的原因仍是长期挑战。现有研究多关注数据、表示或输出等外部因素的变化,却难以揭示模型内部决策机制从训练到测试的演化过程。为此,我们提出决策模式偏移(DPS),将泛化定义为内部决策模式的稳定性,并以偏差度量其失效。具体地,我们使用基于GradCAM的通道贡献向量表示每个样本的决策模式,反映特征通道如何协同支持预测,并提出DPS指标衡量其与类别平均模式的差异。跨多个数据集和架构的实证分析表明:(i) 决策模式形成结构化、类一致的空间,具有强类内凝聚性与低类间混淆,可直接解析模型决策逻辑;(ii) DPS大小与泛化差距呈线性相关(几乎全部皮尔逊相关系数 > 0.8),揭示泛化失败是模型内部决策机制的系统性漂移;(iii) DPS谱将多种泛化退化场景(理想泛化、分布内退化、域偏移、分布外、捷径学习)组织为连续轨迹,提供统一解释。这些发现为早期泛化风险检测、故障模式诊断与通道级缺陷定位开辟了新路径。
原文摘要 · Abstract (English)
Understanding why deep neural networks (DNNs) fail to generalize to unseen samples remains a long-standing challenge. Existing studies mainly examine changes in externally observable factors such as data, representations, or outputs, yet offer limited insight into how a model's internal decision mechanism evolves from training to test. To address this gap, we introduce Decision Pattern Shift (DPS), a new perspective that defines generalization through the stability of internal decision patterns and quantifies failure as their deviation from those learned during training. Specifically, we represent each sample's decision pattern as a GradCAM-based channel-contribution vector, which captures how feature channels collectively support a prediction, and we propose the DPS metric to measure its discrepancy from the class-average pattern. Empirical analyses across multiple datasets and architectures show that, (i) decision patterns form a highly structured, class-consistent space with strong intra-class cohesion and low inter-class confusion, enabling direct analysis of a model's decision logic; (ii) the DPS magnitude correlates linearly with the generalization gap (nearly all Pearson r > 0.8), revealing generalization as a systematic drift in the model's internal decision mechanism; (iii) the DPS spectrum organizes diverse generalization degradation scenarios (covering ideal generalization, in-distribution degradation, domain shift, out-of-distribution, and shortcut learning) into a continuous trajectory, providing a unified explanation of their failure modes. These findings open up new possibilities for early generalization-risk detection, failure-mode diagnosis, and channel-level defect localization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。