arXiv:2505.20894cs.LGcs.HC2025-05中稿 · ISWC'26, 7 pages, …被引 2

通过多尺度窗口建模,提升动作识别的时序连贯性

DeepConvContext: A Multi-Scale Approach to Timeseries Classification in Human Activity Recognition

  • 将时间窗口序列化处理,分别学习窗口内与窗口间特征
  • 在6个基准上平均提升5% F1-score,最高增18点mAP
  • 适合需要精准时序判断的动作识别场景

尽管长期时序依赖建模存在局限,人类活动识别(HAR)仍普遍采用滑动窗口分割标注数据。深度学习模型如DeepConvLSTM通常独立分类每个窗口,使可学习的时序上下文仅限于窗口内,导致活动时间线碎片化、不连贯。为此,我们提出DeepConvContext,一种用于HAR的多尺度时间序列分类框架。受视觉领域时序动作定位启发,该方法通过处理有序窗口序列,分别建模窗口内与窗口间的时序模式。在六个广泛使用的HAR基准上,DeepConvContext实现平均5%的F1-score提升,最高达18点的mAP提升,同时保持与依赖隐藏状态跨批传播的方法相当的延迟和吞吐量。定量与定性分析表明,窗口间学习对生成更连贯的活动片段至关重要,即使在在线预测场景下亦然。代码已公开于www.github.com/mariusbock/deepconvcontext。

原文摘要 · Abstract (English)

Despite recognized limitations in modeling long-range temporal dependencies, Human Activity Recognition (HAR) has traditionally relied on a sliding window approach to segment labeled datasets. Deep learning models like the DeepConvLSTM typically classify each window independently, restricting learnable temporal context to within-window information and producing fragmented, temporally incoherent activity timelines. To address this constraint, we propose DeepConvContext, a multi-scale time series classification framework for HAR. Drawing inspiration from the vision-based Temporal Action Localization community, DeepConvContext models both intra- and inter-window temporal patterns separately by processing sequences of time-ordered windows. Across six widely-used HAR benchmarks, DeepConvContext achieves an average 5% improvement in F1-score and up to 18-point improvement in mAP over related approaches, while achieving latency and throughput comparable to prior methods that extend temporal context through hidden state propagation across batches. Our quantitative and qualitative analysis underline the importance of inter-window learning and show how it produces more coherent activity segments even in online prediction scenarios. Code to reproduce our experiments is publicly available via www.github.com/mariusbock/deepconvcontext.

动作识别时序建模多尺度深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。