低功耗芯片实现实时深度图捕捉，功耗不足1瓦。
SpiderCam: Low-Power Snapshot Depth from Differential Defocus
- 用双焦距图像差分计算深度，硬件部署在低功耗FPGA上。
- 每秒32.5帧，480x400分辨率，工作距离52厘米，总功耗624毫瓦。
- 首次实现被动式FPGA三维相机功耗低于1瓦，适合嵌入式设备。
我们提出SpiderCam，一种基于FPGA的快照式深度感知相机，可在52厘米工作范围内实时生成480x400的稀疏深度图，帧率达32.5 FPS，总功耗仅为624 mW。该系统采用定制相机同步捕获同一场景的两幅不同聚焦图像，并在低功耗FPGA上通过SystemVerilog实现差分对焦深度（DfDD）算法。为突破低功耗传感器限制，我们改进了DfDD算法，并设计了内存本地化的流式处理架构，避免存储整组图像对。这是文献中首个被动式FPGA三维相机实现低于1瓦的总功耗。
原文摘要 · Abstract (English)
We introduce SpiderCam, an FPGA-based snapshot depth-from-defocus camera which produces 480x400 sparse depth maps in real-time at 32.5 FPS over a working range of 52 cm while consuming 624 mW of power in total. SpiderCam comprises a custom camera that simultaneously captures two differently focused images of the same scene, processed with a SystemVerilog implementation of depth from differential defocus (DfDD) on a low-power FPGA. To achieve state-of-the-art power consumption, we present algorithmic improvements to DfDD that overcome challenges caused by low-power sensors, and design a memory-local implementation for streaming depth computation on a device that is too small to store even a single image pair. We report the first sub-Watt total power measurement for passive FPGA-based 3D cameras in the literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。