提出评估时间序列简化方法可解释性的新指标,提升模型决策透明度。
Evaluating Simplification Algorithms for Interpretability of Time Series Classification
- 基于简化后片段数量与分类保真度设计评估指标
- 实验验证四种简化算法在不同数据集上的表现差异
- 通过用户实验确认指标对实际可解释性有指导意义
本文提出用于评估时间序列分类(TSC)中简化方法可解释性的度量标准。由于时间序列数据对人类而言不如文本和图像直观,简化处理对提升可解释性至关重要。所提指标关注简化的复杂度(片段数)和保真度(维持原分类的概率)。聚焦于选择原始数据点子集的简化方法,发现其通常具有高Shapley值,有助于解释。在多种TSC模型与不同特性的数据集(如季节性、平稳性、长短序列)上测试四种简化算法,并通过前向模拟的人类评估验证指标的实际效用。研究结果归纳为一个框架,用于判断特定TSC下简化方法是否有助于可解释性。
原文摘要 · Abstract (English)
In this work, we introduce metrics to evaluate the use of simplified time series in the context of interpretability of a TSC -- a Time Series Classifier. Such simplifications are important because time series data, in contrast to text and image data, are not intuitively under- standable to humans. These metrics are related to the complexity of the simplifications -- how many segments they contain -- and to their loyalty -- how likely they are to maintain the classification of the original time series. We focus on simplifications that select a subset of the original data points, and show that these typically have high Shapley value, thereby aiding interpretability. We employ these metrics to experimentally evaluate four distinct simplification algorithms, across several TSC algorithms and across datasets of varying characteristics, from seasonal or stationary to short or long. We subsequently perform a human-grounded evaluation with forward simulation, that confirms also the practical utility of the introduced metrics to evaluate the use of simplifications in the context of interpretability of TSC. Our findings are summarized in a framework for deciding, for a given TSC, if the various simplifications are likely to aid in its interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。