arXiv:2409.16209cs.CV2024-09被引 4

用大模型提升毫米波对静止人群的检测精度

LLMCount: Enhancing Stationary mmWave Detection with Multimodal-LLM

  • 引入大语言模型分析信号特征,动态补偿功率分布不均
  • 在厅堂、会议室等场景下实现高精度检测,延迟更低
  • 适合需要精准人群计数的智能建筑与公共安全场景

毫米波感知可非侵入式、隐私保护地探测周围人群,应用潜力巨大。但静止人群检测仍面临挑战:微小运动(如呼吸或轻微动作)易被误判为噪声并过滤;信号功率因衰减及外部反射/吸收体干扰而分布不均,影响检测准确率。为此,我们提出 LLMCount,首个利用大语言模型(LLM)增强人群检测性能的系统。通过发挥 LLM 的决策能力,有效补偿信号功率,获得更均匀分布,从而提升检测精度。在厅堂、会议室、电影院等多种场景下进行综合评估,结果表明该方法相比以往方法具有更高检测精度且整体延迟更低。

原文摘要 · Abstract (English)

Millimeter wave sensing provides people with the capability of sensing the surrounding crowds in a non-invasive and privacy-preserving manner, which holds huge application potential. However, detecting stationary crowds remains challenging due to several factors such as minimal movements (like breathing or casual fidgets), which can be easily treated as noise clusters during data collection and consequently filtered in the following processing procedures. Additionally, the uneven distribution of signal power due to signal power attenuation and interferences resulting from external reflectors or absorbers further complicates accurate detection. To address these challenges and enable stationary crowd detection across various application scenarios requiring specialized domain adaption, we introduce LLMCount, the first system to harness the capabilities of large-language models (LLMs) to enhance crowd detection performance. By exploiting the decision-making capability of LLM, we can successfully compensate the signal power to acquire a uniform distribution and thereby achieve a detection with higher accuracy. To assess the system's performance, comprehensive evaluations are conducted under diversified scenarios like hall, meeting room, and cinema. The evaluation results show that our proposed approach reaches high detection accuracy with lower overall latency compared with previous methods.

毫米波感知人群计数大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。