arXiv:2603.23974physics.opticscs.CV2026-03被引 2

在极低光下实现高效图像识别,仅用少量光子即可达成高准确率。

Machine vision with small numbers of detected photons per inference

  • 基于光子统计特性设计神经形态传感,联合优化光学与后处理模块
  • 在每推理仅4.9个光子时,FashionMNIST分类准确率达73%
  • 适用于量子传感、弱光成像等极端低光场景,具有普适扩展潜力

机器视觉(如目标识别与图像重建)是众多消费设备与科学仪器的核心技术。当前系统在中等或明亮光照下表现优异——每像素数千光子,每帧数十亿光子。但在极低光条件下仍面临挑战。本文提出光子感知神经形态传感(PANS),一种面向严重光子匮乏场景的端到端优化方法。训练过程融入低光子预算及探测随机性的先验知识,平均光子数接近或低于每像素1个。实验验证了其在极低光下的可行性:在总光子数仅为4.9(17)个/推理时,FashionMNIST分类准确率达73%(82%);在8.6(29)个光子下,MNIST准确率达86%(97%),远超传统方法。模拟研究还表明,PANS可拓展至分类、事件检测与图像重建任务。通过结合非经典态测量统计或替代传感硬件,该框架可推广至量子传感等光子稀缺场景。

原文摘要 · Abstract (English)

Machine vision, including object recognition and image reconstruction, is a central technology in many consumer devices and scientific instruments. The design of machine-vision systems has been revolutionized by the adoption of end-to-end optimization, in which the optical front end and the post-processing back end are jointly optimized. However, while machine vision currently works extremely well in moderate-light or bright-light situations -- where a camera may detect thousands of photons per pixel and billions of photons per frame -- it is far more challenging in very low-light situations. We introduce photon-aware neuromorphic sensing (PANS), an approach for end-to-end optimization in highly photon-starved scenarios. The training incorporates knowledge of the low photon budget and the stochastic nature of light detection when the average number of photons per pixel is near or less than 1. We report a proof-of-principle experimental demonstration in which we performed low-light image classification using PANS, achieving 73% (82%) accuracy on FashionMNIST with an average of only 4.9 (17) detected photons in total per inference, and 86% (97%) on MNIST with 8.6 (29) detected photons -- orders of magnitude more photon-efficient than conventional approaches. We also report simulation studies showing how PANS could be applied to other classification, event-detection, and image-reconstruction tasks. By taking into account the statistics of measurement results for non-classical states or alternative sensing hardware, PANS could in principle be adapted to enable high-accuracy results in quantum and other photon-starved setups.

低光成像神经形态传感光子效率量子传感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。