让边缘设备用小模型精准理解家用电命令,省资源还快。
SCENIC: Semantic-Conditioned Edge-Aware Neural Framework for Structured IoT Command Generation

- 用小规模模型+语义条件控制,把多种说法统一成标准指令。
- 在微型模型上达99%准确率,压缩后仍保持91%高精度。
- 适合做智能家居边缘部署,尤其看重速度和隐私的场景。
边缘物联网设备受限于内存、隐私、通信延迟和重复推理成本。现有智能家居助手多依赖API接口或云端大模型,难以部署在边缘端。本文将边缘物联网指令生成视为一个‘多对一’结构化输出任务,即多种自然语言指令映射为同一规范命令字符串,以实现确定性解析。为此,提出面向结构化物联网指令生成的语义-边缘感知神经框架SCENIC,涵盖模型选型、智能家庭指令数据生成、三元组损失对比监督微调、剪枝量化及面向部署的导出。评估了亚0.2B量级的Transformer骨干网络,据我们所知,这是目前最小的语言模型骨架用于边缘物联网结构化指令生成的研究。在Smart Home Instruct-Bench上,最强的密集解码器仅达到99.0% EM@1,而编码器-解码器模型在高稀疏度下表现更优。一个代表性剪枝后的INT8编码器-解码器导出版本,在模型大小减少25.38%的同时,保留91.0% EM@1和99.0% EM@5。NVIDIA 2:4稀疏编码器的TensorRT性能分析显示,编码器组件最高提速1.8倍,表明所选路径可在边缘压缩条件下维持结构化指令精度,并具备硬件加速潜力。代码与实验数据已开源,支持可复现性。
原文摘要 · Abstract (English)
Edge Internet of Things (IoT) agents are often constrained by memory capacity, privacy requirements, communication latency, and recurring inference cost. Current smart-home assistants commonly rely on API-level command interfaces or cloud-based language models that remain difficult to deploy on edge devices. This paper addresses edge IoT command generation as a many-to-one structured output task, where multiple natural-language instructions map to the same canonical command string for deterministic smart-home parsing. To support this setting, we propose Semantic-Conditioned Edge-Aware Neural Framework for Structured IoT Command Generation (SCENIC), an end-to-end framework covering model architecture selection, Smart Home Instruct data generation, triplet-loss contrastive supervised fine-tuning, pruning and quantization, and deployment-oriented export. We evaluate sub-0.2B-scale transformer backbones, which are, to the best of our knowledge, among the smallest language-model backbones studied for edge IoT structured command generation. On Smart Home Instruct-Bench, the strongest dense decoder-only row reaches 99.0% EM@1, while the encoder-decoder model retains stronger high-sparsity behavior. A representative pruned INT8 encoder-decoder export preserves 91.0% EM@1 and 99.0% EM@5 while reducing exported model size by 25.38%. TensorRT profiling of the NVIDIA 2:4 sparse encoder export further shows up to 1.8x encoder-component speedup, indicating that the selected encoder-decoder deployment path can retain structured command accuracy under edge-oriented compression while hardware acceleration evidence remains component-level. The SCENIC code and experimental artifacts are open sourced to support reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。