用监控视频分析职场人际互动,自动识别正负情绪
Estimation of Psychosocial Work Environment Exposures Through Video Object Detection. Proof of Concept Using CCTV Footage
- 结合目标检测与姿态估计算法,自动追踪人员并估算互动时长
- 在小规模数据上实现高召回率,但姿态识别仍受限于视频质量
- 适合需客观评估职场心理环境的研究者使用
本文探讨利用计算机视觉算法通过闭路电视(CCTV)录像评估工作场所的心理社会环境。提出一种方法,通过检测和跟踪视频中人员,结合姿态估计(BlazePose)与基于距离、持续时间及姿势的规则分类,估算顾客与员工间的互动性质。该方法整合YOLOv8、DeepSORT与BlazePose算法,用于统计人员数量及互动时长。在小型真实场景数据集上测试,结果显示目标检测与跟踪部分具有高召回率与合理准确率;但因视频质量限制,姿态估计尚无法充分区分互动类型。结果表明,该方法可作为自我报告的补充,为未来外部观测工作环境提供可行路径。
原文摘要 · Abstract (English)
This paper examines the use of computer vision algorithms to estimate aspects of the psychosocial work environment using CCTV footage. We present a proof of concept for a methodology that detects and tracks people in video footage and estimates interactions between customers and employees by estimating their poses and calculating the duration of their encounters. We propose a pipeline that combines existing object detection and tracking algorithms (YOLOv8 and DeepSORT) with pose estimation algorithms (BlazePose) to estimate the number of customers and employees in the footage as well as the duration of their encounters. We use a simple rule-based approach to classify the interactions as positive, neutral or negative based on three different criteria: distance, duration and pose. The proposed methodology is tested on a small dataset of CCTV footage. While the data is quite limited in particular with respect to the quality of the footage, we have chosen this case as it represents a typical setting where the method could be applied. The results show that the object detection and tracking part of the pipeline has a reasonable performance on the dataset with a high degree of recall and reasonable accuracy. At this stage, the pose estimation is still limited to fully detect the type of interactions due to difficulties in tracking employees in the footage. We conclude that the method is a promising alternative to self-reported measures of the psychosocial work environment and could be used in future studies to obtain external observations of the work environment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。