用雷达微多普勒特征高效识别人体动作,模型小巧运行快。
RadMamba: Efficient Human Activity Recognition through Radar-based Micro-Doppler-Oriented Mamba State-Space Model
- 基于雷达微多普勒设计轻量状态空间模型,保留时频结构
- 在多个数据集上达到99.8%准确率,参数仅需对手1/400
- 适合资源受限的分布式雷达系统部署
基于雷达的人体动作识别(HAR)因其非接触、隐私保护和抗遮挡特性,是可穿戴设备与摄像头的替代方案。然而,主流的卷积神经网络(CNN)与循环神经网络(RNN)部署计算开销大,近期轻量级视觉变换器(ViT)与状态空间模型(SSM)仍存在复杂度较高问题。本文提出RadMamba,一种面向雷达HAR的参数高效、微多普勒导向的Mamba状态空间模型,专为边缘传感器的算力、延迟与能耗约束设计。该模型融合通道下采样、多普勒对齐分割与卷积令牌投影,有效保留时频结构的同时降低每推理浮点运算数(#FLOP/Inf.)。在三个不同雷达与动作类型的数据集上评估:在连续波(CW)雷达数据集上达到99.8%准确率,参数量仅为先前最优模型的1/400;在非连续活动的调频连续波(FMCW)数据集上,以约1/10参数量保持92.0%竞争力结果;在连续FMCW数据集上超越参数远多于它的方法至少3%,仅使用6.7k参数。代码开源:https://github.com/lab-emi/AIRHAR。
原文摘要 · Abstract (English)
Radar-based Human Activity Recognition (HAR) is an attractive alternative to wearables and cameras because it preserves privacy, and is contactless and robust to occlusions. However, dominant Convolutional Neural Network (CNN)- and Recurrent Neural Network (RNN)-based solutions are computationally intensive at deployment, and recent lightweight Vision Transformer (ViT) and State Space Model (SSM) variants still exhibit substantial complexity. In this paper, we present RadMamba, a parameter-efficient, micro-Doppler-oriented Mamba SSM tailored to radar HAR under on-sensor compute, latency, and energy constraints typical of distributed radar systems. RadMamba combines (i) channel fusion with downsampling, (ii) Doppler-aligned segmentation that preserves the physical continuity of Doppler over time, and (iii) convolutional token projections that better capture Doppler-span variations, thereby retaining temporal-Doppler structure while reducing the number of Floating-point Operations per Inference (#FLOP/Inf.). Evaluated across three datasets with different radars and types of activities, RadMamba matches the prior best 99.8% accuracy of a recent SSM-based model on the Continuous Wave (CW) radar dataset, while requiring only 1/400 of its parameters. On a dataset of non-continuous activities with Frequency Modulated Continuous Wave (FMCW) radar, RadMamba remains competitive with leading 92.0% results using about 1/10 of the parameters, and on a continuous FMCW radar dataset it surpasses methods with far more parameters by at least 3%, using only 6.7k parameters. Code: https://github.com/lab-emi/AIRHAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。