arXiv:2409.02869cs.LG2024-09被引 29

轻量级时序分类模型LITE仅用2.34%参数量,实现高效低耗且性能不降。

Look Into the LITE in Deep Learning for Time Series Classification

  • 采用深度可分离卷积减少参数,结合多路复用等技术构建轻量结构。
  • 在UCR数据集上训练速度提升2.78倍,碳排放和功耗降低2.79倍。
  • 适用于康复动作识别等实际场景,兼具高效与可解释性。

深度学习在时间序列分类(TSC)中表现优异,但现有先进模型如InceptionTime参数量高,导致训练耗时长、碳排放与功耗高,且浮点运算次数(FLOPS)大。本文提出轻量级架构LITE,仅含9,814个可训练参数,为InceptionTime的2.34%。该模型通过深度可分离卷积(DWSC)及多路复用、自定义滤波器和空洞卷积三重增强技术实现高效压缩。在UCR数据集上,LITE训练速度比InceptionTime快2.78倍,碳排放与能耗降低2.79倍。为处理多变量时间序列,我们进一步提出LITEMV版本,并在基于骨骼的康复运动数据集Kimore上验证其性能:不仅效率最高,且在该任务中表现最优。同时,通过类激活图(CAM)研究模型决策过程,提升可解释性。

原文摘要 · Abstract (English)

Deep learning models have been shown to be a powerful solution for Time Series Classification (TSC). State-of-the-art architectures, while producing promising results on the UCR and the UEA archives , present a high number of trainable parameters. This can lead to long training with high CO2 emission, power consumption and possible increase in the number of FLoating-point Operation Per Second (FLOPS). In this paper, we present a new architecture for TSC, the Light Inception with boosTing tEchnique (LITE) with only 2.34% of the number of parameters of the state-of-the-art InceptionTime model, while preserving performance. This architecture, with only 9, 814 trainable parameters due to the usage of DepthWise Separable Convolutions (DWSC), is boosted by three techniques: multiplexing, custom filters, and dilated convolution. The LITE architecture, trained on the UCR, is 2.78 times faster than InceptionTime and consumes 2.79 times less CO2 and power. To evaluate the performance of the proposed architecture on multivariate time series data, we adapt LITE to handle multivariate time series, we call this version LITEMV. To bring theory into application, we also conducted experiments using LITEMV on multivariate time series representing human rehabilitation movements, showing that LITEMV not only is the most efficient model but also the best performing for this application on the Kimore dataset, a skeleton based human rehabilitation exercises dataset. Moreover, to address the interpretability of LITEMV, we present a study using Class Activation Maps to understand the classification decision taken by the model during evaluation.

时序分类轻量模型可解释性康复分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。