arXiv:2606.04019eess.SPcs.AI2026-06

通过重力感知路由头提升轻量级传感器语言模型对静态动作的识别能力

Gravity-Aware Hierarchical Routing for Lightweight SensorLLM on Human Activity Recognition

论文配图:Gravity-Aware Hierarchical Routing for Lightweight SensorLLM on Human Activity Recognition
图 1 · 摘自论文原文
  • 利用重力统计特征动态选择静态或全量专家进行路由
  • 在MHealth数据集上显著提升静态类别的宏平均F1值
  • 仅增加少量参数,适合部署在资源受限设备上

近年来,传感器-语言对齐研究显示,两阶段框架可增强可穿戴传感器在人体活动识别(HAR)中的语义建模能力。其中,SensorLLM类方法先完成运动到语言的对齐,再微调模型用于下游任务。然而,实验发现当第二阶段主干网络压缩为紧凑模型(如TinyLlama)时,动态活动识别保持良好,但低运动静态类别(如站立、坐着、躺下)的区分能力大幅下降。为此,本文提出一种重力感知的分层路由头,作为已对齐模型上的轻量级后对齐适配器,而非全新的大规模预训练框架。该方法利用Chronos分词器状态中的每通道均值和标准差提取与姿势和重力方向相关的统计线索,通过软路由自适应组合静态专家与全量专家,并引入负载均衡损失以保证训练稳定。在MHealth数据集上,该设计显著提升了宏平均F1值,增益主要集中于静态类别,同时保持对动态活动的强性能。本论文为首次公开,目前仅在单一数据集上报告结果,旨在突出核心方法,为未来更广泛评估奠定基础。

原文摘要 · Abstract (English)

Recent studies on sensor-language alignment have shown that two-stage frameworks can improve the semantic modeling ability of wearable-sensor human activity recognition (HAR), where SensorLLM-style methods first perform motion-to-language alignment and then fine-tune the model for downstream tasks. However, our experiments reveal a consistent failure mode when the Stage 2 backbone is compressed to a compact model such as TinyLlama: recognition of dynamic activities remains relatively strong, while the discrimination of low-motion static classes such as standing, sitting, and lying degrades substantially. To address this issue, we propose a gravity-aware hierarchical routing head as a lightweight post-alignment adaptation built on top of an already aligned model, rather than a new large-scale pretraining framework. The method uses the per-channel mean and std from the Chronos tokenizer state to extract statistical cues related to posture and gravity direction, and adaptively combines a static expert and a full expert through soft routing, together with a load-balancing loss for stable training. On the MHealth dataset, this design significantly improves macro-F1 with minimal parameter overhead, and the gains are concentrated mainly on static classes while preserving strong performance on dynamic activities. As a first arXiv disclosure, the current paper reports results on a single dataset only, with the goal of highlighting the core method and laying the groundwork for broader evaluation in future work.

传感器语言模型动作识别轻量化重力感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。