arXiv:2412.19732cs.LG2024-12被引 1

用GPT式结构提升智能家居活动识别准确率

Generative Pretrained Embedding and Hierarchical Irregular Time Series Representation for Daily Living Activity Recognition

  • 采用Transformer解码器预训练嵌入,类GPT设计
  • 融合时间特征后准确率显著提升,优于现有最优模型
  • 适合做智能家庭行为分析与时序模式挖掘

在智能家居背景下,基于环境传感器数据精确识别日常活动至关重要。本文评估了两种适用于传感器激活的预训练嵌入方法,并提出一种新型分层架构。该架构基于Transformer解码器的预训练嵌入(类GPT设计),对比先前最优的ELMo嵌入。所提分层结构结合两者优势,有效捕捉活动依赖关系与序列顺序,提升分类精度。进一步引入“一天中小时”嵌入以细化时间特征。实验表明,Transformer解码器嵌入在分类任务中表现更优;分层设计显著增强两类嵌入性能,尤其在捕捉跨活动细微差异方面。时间信息的融入虽微弱但明显提升对时间敏感活动的识别效果。结论表明,受GPT启发的分层方法结合时间信息,优于现有最优的ELMo基准。

原文摘要 · Abstract (English)

Within the evolving landscape of smart homes, the precise recognition of daily living activities using ambient sensor data stands paramount. This paper not only aims to bolster existing algorithms by evaluating two distinct pretrained embeddings suited for ambient sensor activations but also introduces a novel hierarchical architecture. We delve into an architecture anchored on Transformer Decoder-based pre-trained embeddings, reminiscent of the GPT design, and contrast it with the previously established state-of-the-art (SOTA) ELMo embeddings for ambient sensors. Our proposed hierarchical structure leverages the strengths of each pre-trained embedding, enabling the discernment of activity dependencies and sequence order, thereby enhancing classification precision. To further refine recognition, we incorporate into our proposed architecture an hour-of-the-day embedding. Empirical evaluations underscore the preeminence of the Transformer Decoder embedding in classification endeavors. Additionally, our innovative hierarchical design significantly bolsters the efficacy of both pre-trained embeddings, notably in capturing inter-activity nuances. The integration of temporal aspects subtly but distinctively augments classification, especially for time-sensitive activities. In conclusion, our GPT-inspired hierarchical approach, infused with temporal insights, outshines the SOTA ELMo benchmark.

活动识别时间序列Transformer智能家居

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。