arXiv:2603.26081eess.SYcs.CV2026-03被引 1

用大模型提升摄像头测人数精度,节能17.94%

Experimental study on surveillance video-based indoor occupancy measurement with occupant-centric control

  • 用大模型优化视觉识别,改进人数检测稳定性
  • 最佳方案准确率0.8824,F1得分0.9320
  • 适合做智能建筑节能研究的工程师参考

精准的人员信息对智慧建筑中的以住客为中心的控制(OCC)至关重要。然而,现有基于视觉的人员测量方法在真实室内环境中常难以保持稳定与准确,且其对后续暖通空调(HVAC)控制的影响尚未充分研究。为实现2050年净零排放目标,本文开展了一项实验研究,探讨大语言模型(LLMs)增强的基于视觉的室内人员测量及其对OCC驱动的HVAC运行的影响。在相同条件下,对比了仅检测、基于追踪以及大模型优化三种流程,使用中国某研究实验室采集的真实监控数据,并进行逐帧人工标注。结果表明,基于追踪的方法比仅检测提升了时间稳定性,而大模型优化进一步提高了测量性能并减少了误判为空的次数。表现最佳的流程(YOLOv8+DeepSeek)达到准确率0.8824,F1分数0.9320。该流程被集成至OpenStudio-EnergyPlus中的HVAC模型预测控制框架。实验显示,所提框架可支持更高效的OCC运行,实现高达17.94%的空调节能潜力。研究为未来人工智能增强的智慧建筑运营提供了有效方法与实践基础。

原文摘要 · Abstract (English)

Accurate occupancy information is essential for closed-loop occupant-centric control (OCC) in smart buildings. However, existing vision-based occupancy measurement methods often struggle to provide stable and accurate measurements in real indoor environments, and their implications for downstream HVAC control remain insufficiently studied. To achieve Net Zero emissions by 2050, this paper presents an experimental study of large language models (LLMs)-enhanced vision-based indoor occupancy measurement and its impact on OCC-enabled HVAC operation. Detection-only, tracking-based, and LLM-based refinement pipelines are compared under identical conditions using real surveillance data collected from a research laboratory in China, with frame-level manual ground-truth annotations. Results show that tracking-based methods improve temporal stability over detection-only measurement, while LLM-based refinement further improves occupancy measurement performance and reduces false unoccupied prediction. The best-performing pipeline, YOLOv8+DeepSeek, achieves an accuracy of 0.8824 and an F1-score of 0.9320. This pipeline is then integrated into an HVAC supervisory model predictive control framework in OpenStudio-EnergyPlus. Experimental results demonstrate that the proposed framework can support more efficient OCC operation, achieving a substantial HVAC energy-saving potential of 17.94%. These findings provide an effective methodology and practical foundation for future research in AI-enhanced smart building operations.

智能建筑视觉测量大模型节能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。