用可控光源和像素级曝光，实现动态场景的高精度实时高光谱视频捕捉。
Lumosaic: Hyperspectral Video via Active Illumination and Coded-Exposure Pixels
- 通过主动照明与像素级曝光同步，提升光子利用效率。
- 30帧/秒、VGA分辨率下恢复31通道（400-700nm）高光谱视频。
- 适用于复杂运动场景，比现有系统更稳定准确。
我们提出Lumosaic，一种紧凑的主动式高光谱视频系统，用于实时捕获动态场景。该系统结合窄带LED阵列与编码曝光像素（CEP）相机，支持高速、像素级曝光控制，可在每一帧视频中联合编码空间、时间与波长信息。与被动快照系统不同，后者在帧曝光期间假设无运动且同时分配光线至多个光谱通道，Lumosaic主动同步照明与像素级曝光，提升了光子利用率并保持运动下的光谱保真度。基于学习的重建流程可恢复31通道（400–700 nm）高光谱视频，帧率30 fps，分辨率为VGA，生成时序连贯且光谱精确的重构结果。在合成与真实数据上的实验表明，Lumosaic显著优于现有快照式高光谱成像系统，在多种材料与运动条件下均具备鲁棒性。
原文摘要 · Abstract (English)
We present Lumosaic, a compact active hyperspectral video system designed for real-time capture of dynamic scenes. Our approach combines a narrowband LED array with a coded-exposure-pixel (CEP) camera capable of high-speed, per-pixel exposure control, enabling joint encoding of scene information across space, time, and wavelength within each video frame. Unlike passive snapshot systems that divide light across multiple spectral channels simultaneously and assume no motion during a frame's exposure, Lumosaic actively synchronizes illumination and pixel-wise exposure, improving photon utilization and preserving spectral fidelity under motion. A learning-based reconstruction pipeline then recovers 31-channel hyperspectral (400-700 nm) video at 30 fps and VGA resolution, producing temporally coherent and spectrally accurate reconstructions. Experiments on synthetic and real data demonstrate that Lumosaic significantly improves reconstruction fidelity and temporal stability over existing snapshot hyperspectral imaging systems, enabling robust hyperspectral video across diverse materials and motion conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。