用低成本投影仪实现动态场景的高精度三维光谱成像
Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes
- 设计光谱复用的结构光图案,大幅减少投影次数
- 实现15.5 nm光谱分辨率、4 mm深度误差、6.6帧/秒
- 适合需要快速获取动态物体材质与形状的应用
高光谱三维成像可同时获取深度图和高光谱图像,实现几何与材料的全面分析。现有方法虽有高光谱与深度精度,但需数分钟采集时间或依赖大型昂贵设备,仅适用于静态场景。本文提出密集分散结构光(DDSL),一种面向动态场景的高精度高光谱三维成像方法,仅需双目RGB相机与配备廉价衍射光栅膜的RGB投影仪。设计光谱复用的DDSL图案,显著减少所需投影模式数量,从而加快采集速度。此外,建立图像形成模型与重建方法,从捕获的双目图像中估计高光谱图像与深度图。作为首个实用且精确的动态场景高光谱三维成像方法,实验表明DDSL实现15.5 nm(FWHM)光谱分辨率、4 mm深度误差和6.6帧/秒帧率。
原文摘要 · Abstract (English)
Hyperspectral 3D imaging captures both depth maps and hyperspectral images, enabling comprehensive geometric and material analysis. Recent methods achieve high spectral and depth accuracy; however, they require long acquisition times often over several minutes or rely on large, expensive systems, restricting their use to static scenes. We present Dense Dispersed Structured Light (DDSL), an accurate hyperspectral 3D imaging method for dynamic scenes that utilizes stereo RGB cameras and an RGB projector equipped with an affordable diffraction grating film. We design spectrally multiplexed DDSL patterns that significantly reduce the number of required projector patterns, thereby accelerating acquisition speed. Additionally, we formulate an image formation model and a reconstruction method to estimate a hyperspectral image and depth map from captured stereo images. As the first practical and accurate hyperspectral 3D imaging method for dynamic scenes, we experimentally demonstrate that DDSL achieves a spectral resolution of 15.5 nm full width at half maximum (FWHM), a depth error of 4 mm, and a frame rate of 6.6 fps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。