arXiv:2511.11885cs.DCcs.AI2025-11被引 2

让普通用户用自然语言快速分析物联网数据,响应速度提升95%。

Flash-Fusion: Enabling Expressive, Low-Latency Queries on IoT Sensor Streams with LLMs

  • 在边缘端压缩数据,减少73.5%原始信息量
  • 云端智能组装提示词,降低98%调用成本
  • 适合城市规划、交通管理等非技术用户快速探索数据

智能城市与普适物联网部署推动了交通与城市规划中物联网数据分析的兴趣。大型语言模型为探索物联网数据提供了新接口,尤其通过自然语言交互。当前用户使用LLM分析物联网数据面临两大挑战:(1)数据采集基础设施昂贵,生成海量低粒度传感器读数,直接使用不现实;(2)分析过程缓慢,需反复迭代且依赖技术专长。直接将全部物联网遥测数据输入LLM不可行,受限于上下文窗口、高昂的令牌成本及非交互式延迟。现有系统缺乏能先解析用户查询以识别分析任务,再选取相关数据片段,并选择合适表示后调用LLM的机制。本文提出Flash-Fusion,一个端-云协同的完整系统,显著降低用户在物联网数据采集与分析上的负担。其设计基于两个原则:(1)边缘端统计摘要实现73.5%的数据压缩以应对数据体量;(2)云端查询规划通过聚类行为数据并构建上下文丰富的提示词,提升数据理解效率。我们在大学公交车队部署Flash-Fusion,并与直接输入原始数据至先进大模型的基线方法对比。结果显示,Flash-Fusion实现95%的延迟降低和98%的令牌消耗与成本下降,同时保持高质量回答。该系统使安全专员、城市规划者、车队管理者与数据科学家等多领域角色,无需手动编写查询或预处理即可高效迭代分析物联网数据。

原文摘要 · Abstract (English)

Smart cities and pervasive IoT deployments have generated interest in IoT data analysis across transportation and urban planning. At the same time, Large Language Models offer a new interface for exploring IoT data - particularly through natural language. Users today face two key challenges when working with IoT data using LLMs: (1) data collection infrastructure is expensive, producing terabytes of low-level sensor readings that are too granular for direct use, and (2) data analysis is slow, requiring iterative effort and technical expertise. Directly feeding all IoT telemetry to LLMs is impractical due to finite context windows, prohibitive token costs at scale, and non-interactive latencies. What is missing is a system that first parses a user's query to identify the analytical task, then selects the relevant data slices, and finally chooses the right representation before invoking an LLM. We present Flash-Fusion, an end-to-end edge-cloud system that reduces the IoT data collection and analysis burden on users. Two principles guide its design: (1) edge-based statistical summarization (achieving 73.5% data reduction) to address data volume, and (2) cloud-based query planning that clusters behavioral data and assembles context-rich prompts to address data interpretation. We deploy Flash-Fusion on a university bus fleet and evaluate it against a baseline that feeds raw data to a state-of-the-art LLM. Flash-Fusion achieves a 95% latency reduction and 98% decrease in token usage and cost while maintaining high-quality responses. It enables personas across disciplines - safety officers, urban planners, fleet managers, and data scientists - to efficiently iterate over IoT data without the burden of manual query authoring or preprocessing.

物联网自然语言低延迟大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。