针对低光成像噪声,提出自适应测量的特征表示方法
Measurement-Adapted Eigentask Representations for Photon-Limited Optical Readout

- 按噪声下可分辨性排序传感器特征,生成更优表示
- 在少样本、高难度分类中性能提升约10个百分点
- 适合光子预算受限的低光成像任务
低光成像中的光学读出受测量噪声(包括光子散粒噪声、探测器噪声和量化误差)的根本限制。在此条件下,下游推理不仅依赖光学前端,还取决于高维传感器测量在分类或决策前的表示方式。本文表明,特征任务(eigentasks)通过根据噪声下的可分辨性对读出特征进行排序,提供了一种测量自适应的表示。利用基于镜头的光学成像系统实验数据及已有单光子检测神经网络的再分析数据,发现 eigentask 表示在多数情况下优于主成分分析和基于滤波的压缩等标准基线。该优势在光子有限、少样本及高难度分类场景中尤为显著。例如,在少样本 MPEG-7 分类任务中,随着类别数增加,性能提升达约10个百分点。在此类设置下,eigentasks 能生成更具信息量的低维特征,提升样本效率。这些结果表明,在光子预算、采集时间和任务复杂度受限时,测量自适应表示是一种有前景的光学推理策略。
原文摘要 · Abstract (English)
Optical readout in low-light imaging is fundamentally limited by measurement noise, including photon shot noise, detector noise, and quantization error. In this regime, downstream inference depends not only on the optical front end, but also on how noisy high-dimensional sensor measurements are represented before classification or decision-making. Here we show that eigentasks provide a measurement-adapted representation for optical sensor outputs by ordering readout features according to their resolvability under noise. Using experimental data from a lens-based optical imaging system and a reanalysis of published data from a single-photon-detection neural network, we find that eigentask representations frequently outperform standard baselines including principal component analysis and filtering-based compression. The advantage is most pronounced in photon-limited, few-shot, and higher-difficulty classification regimes. In few-shot MPEG-7 classification, for example, the advantage over other methods reaches about 10 percentage points as the number of classes increases. In these settings, eigentasks yield more informative low-dimensional features and improve sample-efficient downstream learning. These results identify measurement-adapted representation as a promising strategy for optical inference when photon budget, acquisition time, and task complexity are constrained.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。