arXiv:2608.23192eess.IV2026-08

双摄像头架构实现低功耗持续视觉监测,只在有动作时才启动高耗能模块。

An Energy-Proportional Multimodal and Context-Aware Vision IoT Node

论文配图:An Energy-Proportional Multimodal and Context-Aware Vision IoT Node
图 1 · 摘自论文原文
  • 用事件相机和RGB相机协同工作,仅在运动时激活高功耗部分。
  • 全链路检测+上报耗电仅28.7mJ,每1%活动率可续航三个月。
  • 模型仅100万参数,80类识别精度达32.3% mAP,适合边缘部署。

尽管TinyML显著降低了设备端视觉流程的计算复杂度,图像采集仍是系统能耗与内存占用的主要来源。在视觉物联网平台中,图像传感器功耗与推理引擎相当,抵消了算法优化带来的收益。当前设计面临根本权衡:持续运行导致能耗过高,而激进休眠则增加延迟并可能遗漏瞬态事件。本文提出一种能量比例化的上下文感知视觉物联网节点,采用异构多模态双摄像头架构。通过将事件相机以低功耗始终在线的唤醒运动模式异步运行,配合RGB相机实现检测与识别解耦。部署于低功耗微控制器上,引入新型TinyissimoYOLOv12进行高效准确的目标检测。仅在稀疏视觉触发时激活高功耗采集与处理阶段,提升效率并降低延迟,消除冗余感知同时保持持续监控覆盖。实验表明,系统总能耗仅222μWh;触发后完成从采集到报告的全流程(包含RGB获取、80类目标检测及LoRa遥测)耗电28.7mJ。网络在100万参数下达到最高32.3% mAP。在每日活动率为1%的条件下,1.85Wh电池可支持三月运行,实现无需维护的始终在线视觉监控。

原文摘要 · Abstract (English)

While recent advancements in TinyML have significantly reduced the computational complexity of on-device vision pipelines, image acquisition remains a dominant contributor to system-level energy consumption and memory footprint. In vision-enabled IoT platforms, the image sensor consumes energy comparable to the inference engine, thereby offsetting algorithmic efficiency gains. Consequently, current designs face a fundamental trade-off: continuous and always-on sensing incurs prohibitive energy consumption, whereas aggressive duty cycling increases latency and risks missing transient events. This work presents an energy-proportional, context-aware vision IoT node that addresses this challenge through a heterogeneous multimodal dual-camera architecture. Detection and recognition are decoupled by combining an event-based imager operating asynchronously in an energy-efficient always-on wake-on-motion mode together with an RGB imager. Deployed on a low-power microcontroller, a novel TinyissimoYOLOv12 is introduced for efficient and accurate object detection. By activating the high-power image acquisition and processing stages only upon sparse visual triggers, the proposed architecture improves efficiency and latency, eliminating redundant sensing while maintaining continuous monitoring coverage. Experimental results demonstrate an energy consumption of only 222$μ$Wh. Upon a motion trigger, the system completes a full sense-to-report cycle-RGB acquisition, object detection across 80 classes, and LoRa telemetry-with a total energy consumption of 28.7mJ. The network achieves up to 32.3% mAP with a model size of 1 million parameters. At a 1% daily activity ratio, the platform achieves a three-month operational lifetime with a 1.85Wh battery, enabling always-on visual monitoring in a place-and-forget scenario through autonomous edge intelligence.

视觉物联网低功耗边缘智能双相机

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。