通过联合用户识别提升动作识别精度,让不同用户做相同动作时模型输出更一致。
Contrastive Learning with Auxiliary User Detection for Identifying Activities
- 设计新任务UCA-HAR,同时预测动作和用户身份,增强个性化理解。
- 引入监督对比损失,使相同动作在不同用户间特征更接近,性能提升5.8%-14.1%。
- 适合需跨用户泛化的智能穿戴设备、健康监测等场景使用。
人体动作识别(HAR)在普适计算中有广泛应用。现有前沿研究虽表现优异,但多侧重环境上下文感知(CA),忽视用户个体差异(UA)。本文提出CLAUDIA框架,将用户识别(UI)融入CA-HAR任务,构建用户与上下文双感知的新任务UCA-HAR,联合学习用户不变与用户特异性模式。借鉴视觉领域先进设计,采用监督对比损失优化实例对特征表示,提升模型性能。在三个真实世界数据集上的评估显示,马修相关系数平均提升5.8%~14.1%,宏平均F1得分提升3.0%~7.2%。
原文摘要 · Abstract (English)
Human Activity Recognition (HAR) is essential in ubiquitous computing, with far-reaching real-world applications. While recent SOTA HAR research has demonstrated impressive performance, some key aspects remain under-explored. Firstly, HAR can be both highly contextualized and personalized. However, prior work has predominantly focused on being Context-Aware (CA) while largely ignoring the necessity of being User-Aware (UA). We argue that addressing the impact of innate user action-performing differences is equally crucial as considering external contextual environment settings in HAR tasks. Secondly, being user-aware makes the model acknowledge user discrepancies but does not necessarily guarantee mitigation of these discrepancies, i.e., unified predictions under the same activities. There is a need for a methodology that explicitly enforces closer (different user, same activity) representations. To bridge this gap, we introduce CLAUDIA, a novel framework designed to address these issues. Specifically, we expand the contextual scope of the CA-HAR task by integrating User Identification (UI) within the CA-HAR framework, jointly predicting both CA-HAR and UI in a new task called User and Context-Aware HAR (UCA-HAR). This approach enriches personalized and contextual understanding by jointly learning user-invariant and user-specific patterns. Inspired by SOTA designs in the visual domain, we introduce a supervised contrastive loss objective on instance-instance pairs to enhance model efficacy and improve learned feature quality. Evaluation across three real-world CA-HAR datasets reveals substantial performance enhancements, with average improvements ranging from 5.8% to 14.1% in Matthew's Correlation Coefficient and 3.0% to 7.2% in Macro F1 score.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。