提出基于梯度的检测方法,识别时间序列分类中模型的虚假关联行为。
Gradient-based Model Shortcut Detection for Time Series Classification
- 通过梯度分析定位模型依赖的虚假特征
- 无需测试数据或干净训练集即可检测短路行为
- 首次系统研究时间序列模型的点级短路现象
深度学习在过去二十年中在时间序列分类(TSC)任务中受到广泛关注。近年来,深度神经网络(DNN)已超越传统基于距离的方法,达到领先性能。然而,这些模型被发现会依赖训练数据中的虚假相关性,影响泛化能力。例如,若训练集中多数猫出现在草地背景,模型可能错误关联“草地”与“猫”标签。但现有研究多关注外部属性(如性别、患者分组),对时间序列内部偏差行为的研究仍不足。本文首次系统探究深度学习在时间序列分类中的点级短路学习行为,并提出一种基于梯度的检测方法,可不依赖测试数据或纯净训练类别,直接识别短路现象。我们在UCR时间序列数据集上验证了该方法的有效性。
原文摘要 · Abstract (English)
Deep learning models have attracted lots of research attention in time series classification (TSC) task in the past two decades. Recently, deep neural networks (DNN) have surpassed classical distance-based methods and achieved state-of-the-art performance. Despite their promising performance, deep neural networks (DNNs) have been shown to rely on spurious correlations present in the training data, which can hinder generalization. For instance, a model might incorrectly associate the presence of grass with the label ``cat" if the training set have majority of cats lying in grassy backgrounds. However, the shortcut behavior of DNNs in time series remain under-explored. Most existing shortcut work are relying on external attributes such as gender, patients group, instead of focus on the internal bias behavior in time series models. In this paper, we take the first step to investigate and establish point-based shortcut learning behavior in deep learning time series classification. We further propose a simple detection method based on other class to detect shortcut occurs without relying on test data or clean training classes. We test our proposed method in UCR time series datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。