用自然语言自动生成可解释的AIoT程序,保护隐私还省成本
AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applications
- 基于大模型理解自然语言需求,自动合成带注释的可执行代码
- 本地运行降低隐私风险与调用成本,生成代码性能媲美甚至超越基线
- 适合无编程背景者快速构建智能物联网应用
大型语言模型(LLMs)的兴起深刻改变了人机交互方式,降低了AI使用门槛。尽管LLMs主要用于自然语言交互,但其蕴含的丰富知识使其能够理解数字传感器数据,从而通过物联网设备与物理世界互动,完成多种AIoT任务。这一演变为传统AIoT开发带来范式转变,使非专业用户也能通过自然语言设计和开发应用。然而,现有方案存在将原始传感器数据传至LLM服务器的问题,引发隐私泄露、高昂查询费用及令牌长度限制。此外,LLM推理过程不透明,难以验证结果可靠性。本文提出AutoIOT,一种基于大模型的自动化程序生成系统,用户仅需输入自然语言需求,系统即可自动生成可解释的程序并附带文档。AutoIOT通过自动化迭代优化提升代码质量,用户参与极少。该系统不仅增强了任务执行的可解释性,还在本地运行中缓解了隐私问题并显著降低令牌消耗。大量实验与用户研究证实,AutoIOT在多种AIoT任务中具备卓越的程序合成能力,生成代码表现可比肩甚至优于若干代表性基线。
原文摘要 · Abstract (English)
The advent of Large Language Models (LLMs) has profoundly transformed our lives, revolutionizing interactions with AI and lowering the barrier to AI usage. While LLMs are primarily designed for natural language interaction, the extensive embedded knowledge empowers them to comprehend digital sensor data. This capability enables LLMs to engage with the physical world through IoT sensors and actuators, performing a myriad of AIoT tasks. Consequently, this evolution triggers a paradigm shift in conventional AIoT application development, democratizing its accessibility to all by facilitating the design and development of AIoT applications via natural language. However, some limitations need to be addressed to unlock the full potential of LLMs in AIoT application development. First, existing solutions often require transferring raw sensor data to LLM servers, which raises privacy concerns, incurs high query fees, and is limited by token size. Moreover, the reasoning processes of LLMs are opaque to users, making it difficult to verify the robustness and correctness of inference results. This paper introduces AutoIOT, an LLM-based automated program generator for AIoT applications. AutoIOT enables users to specify their requirements using natural language (input) and automatically synthesizes interpretable programs with documentation (output). AutoIOT automates the iterative optimization to enhance the quality of generated code with minimum user involvement. AutoIOT not only makes the execution of AIoT tasks more explainable but also mitigates privacy concerns and reduces token costs with local execution of synthesized programs. Extensive experiments and user studies demonstrate AutoIOT's remarkable capability in program synthesis for various AIoT tasks. The synthesized programs can match and even outperform some representative baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。