用微型投影仪实现每秒数千帧的单像素图像分类,无需重建图像。
Single Pixel Image Classification using an Ultrafast Digital Light Projector
- 结合单像素成像与轻量模型,用微LED投影仪生成亚毫秒级编码图案。
- 在MNIST数据集上达到95%以上准确率,比传统方法快10倍以上。
- 适合高速场景下的异常检测,如自动驾驶实时感知。
模式识别与图像分类是机器视觉的核心任务。例如,自动驾驶需实时获取并解析动态环境中的复杂信息。本文实验展示了基于单像素成像(SPI)与低复杂度机器学习模型的多千赫兹(kHz)级图像分类系统。采用微LED集成于CMOS的数字光投影仪,实现亚毫秒级图像编码。我们以公认的MNIST手写数字分类任务为基准,对比了极端学习机(ELM)与反向传播训练的深度神经网络的分类性能。两类模型均保持低复杂度,使推理开销与图像生成时间相当。关键在于,该单像素分类方法通过时空变换直接处理信息,完全跳过图像重建步骤。进一步探索基于SPI的ELM作为二分类器,在超高速成像场景中展现出高效异常检测潜力。
原文摘要 · Abstract (English)
Pattern recognition and image classification are essential tasks in machine vision. Autonomous vehicles, for example, require being able to collect the complex information contained in a changing environment and classify it in real time. Here, we experimentally demonstrate image classification at multi-kHz frame rates combining the technique of single pixel imaging (SPI) with a low complexity machine learning model. The use of a microLED-on-CMOS digital light projector for SPI enables ultrafast pattern generation for sub-ms image encoding. We investigate the classification accuracy of our experimental system against the broadly accepted benchmarking task of the MNIST digits classification. We compare the classification performance of two machine learning models: An extreme learning machine (ELM) and a backpropagation trained deep neural network. The complexity of both models is kept low so the overhead added to the inference time is comparable to the image generation time. Crucially, our single pixel image classification approach is based on a spatiotemporal transformation of the information, entirely bypassing the need for image reconstruction. By exploring the performance of our SPI based ELM as binary classifier we demonstrate its potential for efficient anomaly detection in ultrafast imaging scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。