针对课堂监控图像中少量新活动的持续学习难题,提出高效识别方案。
Few-Shot Continual Learning for Activity Recognition in Classroom Surveillance Images
- 结合对比学习与自适应协方差分类器,提升模型泛化能力。
- 在真实课堂数据集上准确识别罕见非教学行为,性能优于现有方法。
- 适合需要低样本增量学习的教育智能监控系统开发者。
AI+教育领域中活动识别应用日益受到关注。然而,现有研究多聚焦于人工拍摄视频中的有限活动类型,对真实课堂监控图像中的活动识别关注较少。真实课堂中,阅读等教学活动占比高,而进食等非教学活动虽稀少但持续出现。这要求模型能从少量样本中学习新活动,同时不遗忘已有教学活动,亟需少样本持续学习(FSCL)能力。为此,我们构建了面向课堂监控图像活动识别的持续学习数据集ARIC,具有多视角、多样活动和真实场景优势,但也面临活动相似性和样本分布不均的挑战。为此,我们设计了一种融合监督对比学习(SCL)与自适应协方差分类器(ACC)的少样本持续学习方法。基础阶段,提出基于特征增强的SCL方法以提升模型泛化能力;增量阶段,采用ACC更精准描述新类别的分布。实验表明,该方法在ARIC数据集上优于现有方法。
原文摘要 · Abstract (English)
The application of activity recognition in the "AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity types, with little attention given to recognizing activities in surveillance images from real classrooms. In real classroom settings, normal teaching activities such as reading, account for a large proportion of samples, while rare non-teaching activities such as eating, continue to appear. This requires a model that can learn non-teaching activities from few samples without forgetting the normal teaching activities, which necessitates fewshot continual learning (FSCL) capability. To address this gap, we constructed a continual learning dataset focused on classroom surveillance image activity recognition called ARIC (Activity Recognition in Classroom). The dataset has advantages such as multiple perspectives, a wide variety of activities, and real-world scenarios, but it also presents challenges like similar activities and imbalanced sample distribution. To overcome these challenges, we designed a few-shot continual learning method that combines supervised contrastive learning (SCL) and an adaptive covariance classifier (ACC). During the base phase, we proposed a SCL approach based on feature augmentation to enhance the model's generalization ability. In the incremental phase, we employed an ACC to more accurately describe the distribution of new classes. Experimental results demonstrate that our method outperforms other existing methods on the ARIC dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。