arXiv:2606.01271cs.CV2026-06中稿 · the XXIV Annual Co…

将计算搬到传感器端,大幅降低卫星遥感数据传输能耗。

Exploiting In-Sensor Computing for Energy-Efficient Earth Observation

  • 在传感器级直接处理数据,减少无效信息上传。
  • 模型精度达96.68%,每帧处理仅27.43毫秒,耗能14.19毫焦。
  • 适合资源受限的星载系统,尤其关注能效的遥感任务。

卫星产业的快速发展带来了海量地理空间数据,但地面站下行带宽严重不足成为瓶颈。本文提出一种基于索尼IMX500智能视觉传感器的传感器级计算框架,通过融合TinyML技术,将深度学习推理直接部署于传感器端,显著减少冗余数据传输。针对计算资源严格受限的场景,我们在EuroSAT数据集上评估了SqueezeNet、ShuffleNetV2和MCUNetV1等轻量级卷积神经网络,结果表明:模型在8MB内存限制下仍保持96.68%的准确率,平均处理吞吐率达17.40 FPS,延迟27.43毫秒。系统能耗仅为14.19 mJ/推理,能效达42.26 GMAC/J,验证了其在星载环境下的可行性与高效性。

原文摘要 · Abstract (English)

The rapid growth of the satellite industry has driven a significant increase in geospatial data acquisition, highlighting a critical bottleneck: the severe disparity between the volume of collected sensor data and the limited downlink bandwidth available to ground stations. While On-Board Computing (OBC) has helped address this by pre-processing data in orbit, this article further advances the paradigm by introducing an in-sensor computing framework. We present an optimized end-to-end Earth Observation (EO) pipeline tailored for strict computational constraints by integrating TinyML techniques with the Sony IMX500 Intelligent Vision Sensor. Specifically, our approach shifts processing directly to the sensor level, offloading the computation from the primary embedded device, and effectively mitigating the downlink transmission of noisy or irrelevant data. We evaluated several efficient Convolutional Neural Networks (ConvNets), i.e., SqueezeNet, ShuffleNetV2, and MCUNetV1, on the EuroSAT dataset. Experimental results show that, despite the optimizations required for deployment on the IMX500 platform, our models maintain a competitive 96.68% accuracy while operating within its 8 MB constraints. Specifically, the models reach an average processing throughput of 17.40 FPS with a latency of 27.43 ms. Furthermore, our system profile exhibits high energy efficiency, with a low energy footprint of 14.19 mJ per inference and an efficiency rating of 42.26 GMAC/J, demonstrating its viability for in-sensor deployment.

传感器计算遥感能效优化TinyML

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。