用传感器网络实时监测学生课堂专注度,保护隐私且无需干扰教学。
A Biometric Sensor Network to Enable Real-Time Measurement of Individual Student Engagement in STEM Lecture Environments

- 部署分布式传感节点,本地处理视频数据以避免外泄。
- 支持10秒视频片段的实时分析,不存储原始画面。
- 适合教育研究者与智慧教室系统开发者使用。
学生参与度(SE)是预测理工科教育中学业表现与留校率的关键指标,但现有测量方法常具侵入性、人工成本高或不适用于实时课堂环境。本文提出一种新型生物特征传感器网络(BSN),旨在实现对理工科课堂环境中个体学生参与度的实时测量与持续追踪。该系统通过基于摄像头的感知技术,无感采集行为、情绪与认知指标,同时满足伦理与隐私要求。所提方案由学生处理单元(SPU)构成分布式传感节点,支持两种模式:(i) 数据集采集模式,临时记录原始视频以构建私有参与度数据集用于模型训练与验证;(ii) 分析模式,对10秒视频片段进行本地实时推理,不存储或传输原始帧。在分析模式下,每个SPU实现全设备端处理——包括人脸检测、凝视估计与情感分析——确保无任何可识别视频数据流出设备。安全后端架构负责设备认证、会话编排与加密数据接收。整个系统整合了硬件设计、计算机视觉流程、无线网络、安全协议与会话级数据管理。
原文摘要 · Abstract (English)
Student engagement (SE) is a critical predictor of academic performance and retention in STEM education, yet existing measurement approaches are often intrusive, manually intensive, or unsuitable for real-time classroom use. This thesis proposes a novel $\textit{Biometric Sensor Network}$ (BSN) designed to enable real-time measurement and continuous tracking of individual student engagement in STEM classroom environments. The system enables capturing of behavioral, emotional, and cognitive indicators through camera-based sensing while preserving ethical and privacy constraints. To measure these indicators unobtrusively and ethically, we propose a BSN composed of $\textit{Student Processing Units}$ (SPUs) that function as distributed sensing nodes. The network is explicitly designed to satisfy five objectives: it must be $\textbf{non-intrusive}, \textbf{non-invasive}, \textbf{non-stigmatizing}, \textbf{real-time}$, and $\textbf{automatic}$, while ensuring rigorous protection of student data security and privacy. Each SPU supports two operational modes: (i) a $\textit{dataset-collection mode}$, in which raw student video is temporarily recorded to construct a private SE dataset for model training and validation, and (ii) an $\textit{analysis mode}$, in which the SPU performs real-time inference on 10-second video segments without storing or transmitting raw frames. In this analysis role, each SPU enables fully on-device processing---including face detection, gaze estimation, and affective analysis---ensuring that no identifiable video data leaves the device. A secure backend infrastructure manages device authentication, session orchestration, and encrypted data ingestion. The full system integrates hardware design, computer-vision pipelines, wireless networking, security protocols, and session-level data management.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。