轻量级模型FAIM通过频域感知提升时间序列分类精度与鲁棒性。
FAIM: Frequency-Aware Interactive Mamba for Time Series Classification
- 引入傅里叶变换与自适应阈值,动态抑制噪声并融合多频段特征。
- 在多个基准上超越现有SOTA方法,准确率与效率平衡出色。
- 适合小样本、高噪声场景,尤其适用于医疗、环境等实时监测任务。
时间序列分类(TSC)在环境监测、医疗诊断和姿态识别等场景中至关重要。尽管深度学习模型能捕捉时序依赖,但常面临计算开销大、对噪声敏感及小数据集过拟合问题。为此,本文提出轻量级频率感知交互式Mamba模型FAIM。设计自适应滤波模块(AFB),利用傅里叶变换提取频域特征,引入可学习的自适应阈值动态抑制噪声,并实现全局与局部语义特征的逐元素耦合,深化不同频段间的协同建模。同时构建交互式Mamba模块(IMB),促进多粒度信息交互,在细粒度判别特征与全局上下文间取得平衡,增强表示能力。此外,引入自监督预训练机制,提升对复杂时序模式的理解力与跨域鲁棒性。大量实验表明,FAIM在多个基准上持续优于当前最优方法,实现了准确率与效率的优越权衡,表现卓越。
原文摘要 · Abstract (English)
Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition. TSC tasks require models to effectively capture discriminative information for accurate class identification. Although deep learning architectures excel at capturing temporal dependencies, they often suffer from high computational cost, sensitivity to noise perturbations, and susceptibility to overfitting on small-scale datasets. To address these challenges, we propose FAIM, a lightweight Frequency-Aware Interactive Mamba model. Specifically, we introduce an Adaptive Filtering Block (AFB) that leverages Fourier Transform to extract frequency-domain features from time series data. The AFB incorporates learnable adaptive thresholds to dynamically suppress noise and employs element-wise coupling of global and local semantic adaptive filtering, enabling in-depth modeling of the synergy among different frequency components. Furthermore, we design an Interactive Mamba Block (IMB) to facilitate efficient multi-granularity information interaction, balancing the extraction of fine-grained discriminative features and comprehensive global contextual information, thereby endowing FAIM with powerful and expressive representations for TSC tasks. Additionally, we incorporate a self-supervised pre-training mechanism to enhance FAIM's understanding of complex temporal patterns and improve its robustness across various domains and high-noise scenarios. Extensive experiments on multiple benchmarks demonstrate that FAIM consistently outperforms existing state-of-the-art (SOTA) methods, achieving a superior trade-off between accuracy and efficiency and exhibits outstanding performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。