通过文本预处理提升边缘AI模型精度,实现云级分析效果
Enabling Cloud-Level Accuracy in Edge AI through IoT Data Preprocessing

- 将原始传感器数据转为分层文本描述,增强输入信息
- 边缘模型准确率从50.9%升至81.7%(室内)和63.7%升至89.3%(室外)
- 轻量级预处理可让本地模型逼近云端性能,适合低延迟物联网场景
大型语言模型(LLMs)为智能环境中的物联网(IoT)传感器数据提供自然语言接口,但云端部署存在延迟、隐私和连接问题。本地部署的LLM虽能缓解这些问题,但紧凑型边缘模型在直接接收原始传感器读数时,数值推理能力较弱。本文研究了提示预处理是否能改善本地LLM在环境监测中的精度-延迟权衡。提出一种结构化提示构建框架,将空气质量与热舒适度原始数据转化为逐步丰富的文本表示:原始值、阈值感知描述及紧凑环境摘要标志。基于坦佩雷大学的室内Raspberry Pi/BME680数据集及赫尔辛基、卡托维兹、华沙的室外空气质量数据集进行评估。构建覆盖空气质量、热舒适度及联合环境条件的二分类LLM查询数据集,测试五种本地与五种云端模型,在三种提示变体与两种推理模式下对比,含/不含思维链(CoT)提示。结果显示,提示丰富显著提升本地模型准确率:无思维链模式下,室内准确率从50.9%升至81.7%,室外从63.7%升至89.3%。本地无思维链推理最快,平均延迟接近0.22秒,而思维链显著增加推理时间。结果表明,轻量级提示预处理可缩小本地与云端性能差距,支持智能环境中低延迟的物联网分析。
原文摘要 · Abstract (English)
Large language models (LLMs) offer a natural-language interface for interpreting Internet of Things (IoT) sensor data in smart environments; however, cloud deployment introduces latency, privacy, and connectivity concerns. Local LLMs can reduce these limitations, but compact edge-deployable models often show weaker numerical reasoning when raw sensor readings are provided directly. This paper investigates whether prompt-side preprocessing can improve the accuracy-latency trade-off of local LLMs for environmental monitoring. We propose a structured prompt construction framework that transforms raw air-quality and thermal-comfort measurements into progressively enriched textual representations: raw sensor values, threshold-aware descriptions, and compact environmental summary flags. The approach is evaluated using indoor Raspberry Pi/BME680 datasets from Tampere University and outdoor air-quality datasets from Helsinki, Katowice, and Warsaw. We construct a binary LLM query dataset covering air quality, thermal comfort, and joint environmental conditions, and evaluate five local and five cloud LLMs across three prompt variants and two inference modes, with and without chain-of-thought prompting. Results show that prompt enrichment substantially improves local-model accuracy. In No-CoT mode, local accuracy increases from 50.9% to 81.7% indoors and from 63.7% to 89.3% outdoors from the raw to the most enriched prompt. Local No-CoT inference is the fastest configuration, with mean latency close to 0.22 s, while CoT substantially increases inference time. These findings suggest that lightweight prompt-side preprocessing can narrow the local--cloud performance gap and support low-latency IoT analytics in smart environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。