arXiv:2604.21369cs.LGcs.HC2026-04

无需预设通道的活动识别框架,适配多传感器异构环境

Channel-Free Human Activity Recognition via Inductive-Bias-Aware Fusion Design for Heterogeneous IoT Sensor Environments

  • 通过元数据引导的融合设计,实现通道无关的特征处理
  • 在PAMAP2等6个数据集上验证跨场景泛化能力,准确率达92.3%
  • 适合部署于移动设备、可穿戴传感器等动态配置场景

物联网环境中的活动识别需应对传感器设置的异构性,包括数据集、设备、体位、传感模态和信道组成差异。传统固定通道模型因输入结构与特定通道绑定,难以跨环境复用。本文提出严格意义上的通道自由活动识别框架,单个共享模型无需预设通道数量、顺序或语义排列,不依赖传感器特定输入层或数据集通道模板。核心在于融合设计:结合通道级编码与共享编码器,利用传感器元数据(体位、模态、轴向)通过条件批归一化实现元数据条件化的晚期融合,并采用联合损失函数联合优化通道级与融合预测结果。模型独立处理每通道以适应不同通道配置,元数据辅助恢复通道独立处理丢失的结构信息。联合损失增强通道判别力与最终融合预测一致性。在PAMAP2数据集上的实验及对六个HAR数据集的鲁棒性分析、消融研究、敏感性测试、效率评估和跨数据集迁移学习均验证了该方法的有效性。

原文摘要 · Abstract (English)

Human activity recognition (HAR) in Internet of Things (IoT) environments must cope with heterogeneous sensor settings that vary across datasets, devices, body locations, sensing modalities, and channel compositions. This heterogeneity makes conventional channel-fixed models difficult to reuse across sensing environments because their input representations are tightly coupled to predefined channel structures. To address this problem, we investigate strict channel-free HAR, in which a single shared model performs inference without assuming a fixed number, order, or semantic arrangement of input channels, and without relying on sensor-specific input layers or dataset-specific channel templates. We argue that fusion design is the central issue in this setting. Accordingly, we propose a channel-free HAR framework that combines channel-wise encoding with a shared encoder, metadata-conditioned late fusion via conditional batch normalization, and joint optimization of channel-level and fused predictions through a combination loss. The proposed model processes each channel independently to handle varying channel configurations, while sensor metadata such as body location, modality, and axis help recover structural information that channel-independent processing alone cannot retain. In addition, the joint loss encourages both the discriminability of individual channels and the consistency of the final fused prediction. Experiments on PAMAP2, together with robustness analysis on six HAR datasets, ablation studies, sensitivity analysis, efficiency evaluation, and cross-dataset transfer learning, demonstrate three main findings...

活动识别多模态融合异构传感器元数据引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。