arXiv:2501.10917cs.CVcs.AI2025-01AAAI被引 6

分解并融合多传感器时空信号,提升可穿戴设备动作识别精度

Decomposing and Fusing Intra- and Inter-Sensor Spatio-Temporal Signal for Multi-Sensor Wearable Human Activity Recognition

  • 分阶段处理:先分解各传感器内部特征,再融合跨传感器关系
  • 在三个数据集上超越现有模型,准确率显著提升
  • 适合需要高精度动作识别的智能健康监测场景

可穿戴人体动作识别(WHAR)是普适计算中的重要研究方向。多传感器同步测量比单传感器更有效,但现有方法对所有传感器变量使用相同的卷积核进行时间特征提取,无法有效捕捉传感器内与传感器间的时空关系。本文提出DecomposeWHAR模型,包含分解与融合两阶段:分解阶段通过改进的深度可分离卷积为每个传感器变量生成高维表征,捕捉局部时间特征并保留其独特性;融合阶段首先在通道和变量层面融合传感器内特征,再利用状态空间模型(SSM)建模长时依赖,并通过自注意力机制动态捕获跨传感器交互,突出传感器间空间相关性。模型在三个主流WHAR数据集上表现优异,显著优于当前最优模型,同时保持合理的计算效率。

原文摘要 · Abstract (English)

Wearable Human Activity Recognition (WHAR) is a prominent research area within ubiquitous computing. Multi-sensor synchronous measurement has proven to be more effective for WHAR than using a single sensor. However, existing WHAR methods use shared convolutional kernels for indiscriminate temporal feature extraction across each sensor variable, which fails to effectively capture spatio-temporal relationships of intra-sensor and inter-sensor variables. We propose the DecomposeWHAR model consisting of a decomposition phase and a fusion phase to better model the relationships between modality variables. The decomposition creates high-dimensional representations of each intra-sensor variable through the improved Depth Separable Convolution to capture local temporal features while preserving their unique characteristics. The fusion phase begins by capturing relationships between intra-sensor variables and fusing their features at both the channel and variable levels. Long-range temporal dependencies are modeled using the State Space Model (SSM), and later cross-sensor interactions are dynamically captured through a self-attention mechanism, highlighting inter-sensor spatial correlations. Our model demonstrates superior performance on three widely used WHAR datasets, significantly outperforming state-of-the-art models while maintaining acceptable computational efficiency.

动作识别多传感器时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。