arXiv:2504.13942cs.HCcs.AI2025-04被引 4

让智能家居用空间位置说话,不用记设备名也能自然指令控制。

Intelligence of Things: A Spatial Context-Aware Control System for Smart Devices

  • 用视觉语言模型融合物联网,理解'靠近窗边的灯'这类空间指令。
  • 用户测试显示认知负担降低13.17分,14人更偏爱该系统。
  • 适合不想记设备名、追求自然交互的智能家庭用户。

本文提出Intelligence of Things(INOT),一种新型空间上下文感知的智能设备控制系统,通过直观的空间推理提升智能家居自动化体验。现有系统依赖设备专属标识符,用户只能使用命名指令,难以实现自然的空间描述。INOT采用模块化架构,将视觉语言模型与物联网控制系统结合,支持基于空间上下文的自然语言命令(如“打开靠近窗户的灯”)。系统包含上车推断引擎、零样本设备检测、空间拓扑推断和意图驱动指令合成等核心组件。15名参与者参与的综合用户研究显示,相比Google Home Assistant等传统系统,INOT显著降低用户认知负荷(NASA-TLX评分平均下降13.17分),易用性评价更高,且14名参与者表示更偏好该系统。通过消除对设备标识符的记忆需求,实现上下文感知的自然空间指令,INOT在构建更直观、更易用的智能家居控制体系方面迈出关键一步。

原文摘要 · Abstract (English)

This paper introduces Intelligence of Things (INOT), a novel spatial context-aware control system that enhances smart home automation through intuitive spatial reasoning. Current smart home systems largely rely on device-specific identifiers, limiting user interaction to explicit naming conventions rather than natural spatial references. INOT addresses this limitation through a modular architecture that integrates Vision Language Models with IoT control systems to enable natural language commands with spatial context (e.g., "turn on the light near the window"). The system comprises key components including an Onboarding Inference Engine, Zero-Shot Device Detection, Spatial Topology Inference, and Intent-Based Command Synthesis. A comprehensive user study with 15 participants demonstrated INOT's significant advantages over conventional systems like Google Home Assistant, with users reporting reduced cognitive workload (NASA-TLX scores decreased by an average of 13.17 points), higher ease-of-use ratings, and stronger preference (14 out of 15 participants). By eliminating the need to memorize device identifiers and enabling context-aware spatial commands, INOT represents a significant advancement in creating more intuitive and accessible smart home control systems.

智能家庭空间感知自然语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。