用原始拜耳图像实现低功耗肠镜定位,93%准确率仅需6.3万参数。
Smart Video Capsule Endoscopy: Raw Image-Based Localization for Enhanced GI Tract Investigation
- 直接处理拜耳图像,跳过耗能的RGB转换
- 6.3万参数小模型+维特比解码,93.06%定位准确率
- 每帧仅耗5.31微焦,比传统胶囊省电89.9%
针对资源受限的传感器边缘设备,本文提出面向视频胶囊内镜的高效人工智能方案。该技术用于小肠检查,受电池寿命严重制约。通过直接在拜耳图像上进行卷积神经网络(63,000参数)与时间序列分析(维特比解码),实现93.06%的器官分类准确率。实验基于定制PULPissimo SoC(RISC-V核心+超低功耗硬件加速器),每帧仅消耗5.31 μJ能量,相比传统视频胶囊平均节省89.9%能耗。该方法避免了图像转换开销,为边缘医疗设备提供高能效智能分析方案。
原文摘要 · Abstract (English)
For many real-world applications involving low-power sensor edge devices deep neural networks used for image classification might not be suitable. This is due to their typically large model size and require- ment of operations often exceeding the capabilities of such resource lim- ited devices. Furthermore, camera sensors usually capture images with a Bayer color filter applied, which are subsequently converted to RGB images that are commonly used for neural network training. However, on resource-constrained devices, such conversions demands their share of energy and optimally should be skipped if possible. This work ad- dresses the need for hardware-suitable AI targeting sensor edge devices by means of the Video Capsule Endoscopy, an important medical proce- dure for the investigation of the small intestine, which is strongly limited by its battery lifetime. Accurate organ classification is performed with a final accuracy of 93.06% evaluated directly on Bayer images involv- ing a CNN with only 63,000 parameters and time-series analysis in the form of Viterbi decoding. Finally, the process of capturing images with a camera and raw image processing is demonstrated with a customized PULPissimo System-on-Chip with a RISC-V core and an ultra-low power hardware accelerator providing an energy-efficient AI-based image clas- sification approach requiring just 5.31 μJ per image. As a result, it is possible to save an average of 89.9% of energy before entering the small intestine compared to classic video capsules.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。