arXiv:2605.04617cs.CVcs.HC2026-05

利用时间结构提升可穿戴设备动作识别的实时自适应能力

Temporal Structure Matters for Efficient Test-Time Adaptation in Wearable Human Activity Recognition

论文配图:Temporal Structure Matters for Efficient Test-Time Adaptation in Wearable Human Activity Recognition
图 1 · 摘自论文原文
  • 将时间连续性作为推理信号,动态调整模型更新策略
  • 在真实数据集上性能超越现有方法,计算开销更低
  • 适合资源受限的边缘设备实时部署

可穿戴人体动作识别(WHAR)模型在跨用户分布偏移下常出现性能下降。测试时自适应(TTA)通过在线使用无标签测试流来缓解此问题,但现有方法多沿用视觉任务假设,未能充分利用WHAR数据流中窗口间的时间结构。本文将时间结构重新视为特征条件化的推理信号,而非简单的输出平滑先验。我们发现时间连续性与观测引起的特征偏差为判断何时保持或释放时间惯性、何处进行预测优化提供了互补线索。基于此,提出SIGHT框架——一种轻量级、无需反向传播的WHAR TTA方法,支持实时边缘部署。SIGHT通过比较当前特征与基于原型的期望状态,估计预测意外度,并利用特征偏差引导基于原型对齐和流级习惯跟踪的几何感知过渡路由。在真实数据集上的评估表明,SIGHT优于现有基线,同时显著降低计算与内存开销。

原文摘要 · Abstract (English)

Wearable human activity recognition (WHAR) models often suffer from performance degradation under real-world cross-user distribution shifts. Test-time adaptation (TTA) mitigates this degradation by adapting models online using unlabeled test streams, yet existing methods largely inherit assumptions from vision tasks and underexploit the inherent inter-window temporal structure in WHAR streams. In this paper, we revisit such temporal structure as a feature-conditioned inference signal rather than merely an output-space smoothing prior. We derive the insight that temporal continuity and observation-induced feature deviations provide complementary cues for determining when to preserve or release temporal inertia and where to route prediction refinement during likely transitions. Building upon this insight, we propose SIGHT, a lightweight and backpropagation-free TTA framework for WHAR, enabling real-time edge deployment. SIGHT estimates predictive surprise by comparing the current feature with a prototype-based expected state, and then uses the resulting feature deviation to guide geometry-aware transition routing based on prototype alignment and stream-level marginal habit tracking. Evaluations on real-world datasets confirm that SIGHT outperforms existing TTA baselines while reducing computational and memory costs.

动作识别边缘计算自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。