用注意力机制实现多用户活动识别,兼顾精度与低带宽传输。
AMAR: Lightweight Attention-Based Multi-User Activity Recognition from Wi-Fi CSI

- 将多用户活动识别建模为集合预测问题,利用可学习查询检测多种动作。
- 在真实场景中比最佳基线提升近一倍的全活动识别率,F1达53.4%。
- 边缘侧轻量卷积+残差向量量化,大幅降低带宽,适合实际部署。
基于Wi-Fi的人体活动识别(HAR)作为无接触感知的新兴方法,利用无线收发器采集的信道状态信息(CSI)进行分析。现有研究多聚焦单用户场景,而现实环境常涉及多个用户同时活动,导致CSI模式重叠,挑战传统分类方法。为此,本文提出一种基于注意力机制的多用户活动识别框架(AMAR),将HAR建模为集合预测问题。AMAR采用Transformer架构,通过可学习查询嵌入作为专用活动检测器,实现从复合CSI表示中同步识别多个活动。此外,系统采用边缘-云分层架构:边缘设备使用轻量卷积网络完成初始特征提取,随后通过残差向量量化显著降低带宽,同时保留活动判别信息。云端通过注意力驱动的集合匹配完成最终活动预测,可适应不同人数场景。在教室、会议室和空房间环境中,平均而言,AMAR近乎将完全识别所有并发活动的准确率提升一倍,相比最优基线,F1分数达53.4%(基线45.6%),占用估计误差降低74%,且大幅减少通信开销。
原文摘要 · Abstract (English)
Wi-Fi-based human activity recognition (HAR) has emerged as a promising approach for contactless sensing, leveraging channel state information (CSI) collected from wireless transceivers. While existing studies have primarily concentrated on single-user scenarios, real-world deployments often involve multi-user settings where concurrent users' movements induce overlapping CSI patterns that challenge conventional classification methods. To address this limitation, this paper introduces an attention-based multi-user activity recognition (AMAR) framework that formulates HAR as a set prediction problem. The transformer-based architecture in AMAR leverages learnable query embeddings acting as specialized activity detectors, enabling the simultaneous identification of multiple activities from composite CSI representations. Moreover, to address deployment constraints, AMAR is designed in an edge-cloud split architecture form where lightweight convolutional networks on edge devices perform initial feature extraction, followed by residual vector quantization that achieves substantial bandwidth reduction while preserving activity-discriminative information. The cloud component performs final activity prediction through attention-based set matching, enabling the system to handle varying occupancy levels. Across classroom, meeting-room, and empty-room environments, on average AMAR nearly doubles the rate of perfectly predicting all concurrent activities compared to the best baseline. Moreover, it achieves an $F_1$-score of 53.4% compared to 45.6% for the best benchmark, and reduces occupancy estimation error by 74%, while minimizing bandwidth substantially.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。