用神经网络内部激活值快速计算特征重要性,适合实时解释。
DeepACTIF: Efficient Feature Attribution via Activation Traces in Neural Sequence Models
- 基于LSTM的激活值反向加权聚合,提升特征重要性估计稳定性。
- 仅用前10%关键特征,模型性能几乎不变,且优于SHAP等方法。
- 计算量降为原来的百分之一,适合手机、可穿戴设备实时运行。
特征归因对理解深度学习模型至关重要,尤其在医疗、生物识别和人机交互等时序领域。然而,标准方法如积分梯度(IG)或SHAP计算成本高,难以用于实时场景。本文提出DeepACTIF,一种轻量级、结构感知的特征归因方法,利用序列模型内部激活值高效估算特征重要性。针对LSTM网络,引入反向加权聚合策略,强调激活值在时间步上的稳定性和幅度。在三个生物识别注视数据集上的评估显示,DeepACTIF在严重特征压缩(仅保留前10%特征)下仍保持预测性能,且在准确性和统计稳健性上显著优于SHAP、IG和DeepLIFT。通过威尔科xon符号秩检验与效应量分析,证实其在所有top-k条件(10%-40%)下误差更低、特征排序更有效。实验表明,DeepACTIF将计算时间和内存消耗降低至原有水平的百分之一以下,同时使用顶级特征仍能保持模型精度,适用于移动XR头显或嵌入式健康监测等边缘设备的实时可解释性需求。
原文摘要 · Abstract (English)
Feature attribution is essential for interpreting deep learning models, particularly in time-series domains such as healthcare, biometrics, and human-AI interaction. However, standard attribution methods, such as Integrated Gradients or SHAP, are computationally intensive and not well-suited for real-time applications. We present DeepACTIF, a lightweight and architecture-aware feature attribution method that leverages internal activations of sequence models to estimate feature importance efficiently. Focusing on LSTM-based networks, we introduce an inverse-weighted aggregation scheme that emphasises stability and magnitude of activations across time steps. Our evaluation across three biometric gaze datasets shows that DeepACTIF not only preserves predictive performance under severe feature reduction (top 10% of features) but also significantly outperforms established methods, including SHAP, IG, and DeepLIFT, in terms of both accuracy and statistical robustness. Using Wilcoxon signed-rank tests and effect size analysis, we demonstrate that DeepACTIF yields more informative feature rankings with significantly lower error across all top-k conditions (10 - 40%). Our experiments demonstrate that DeepACTIF not only reduces computation time and memory usage by orders of magnitude but also preserves model accuracy when using only top-ranked features. That makes DeepACTIF a viable solution for real-time interpretability on edge devices such as mobile XR headsets or embedded health monitors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。