用光学微分对实现低功耗高精度3D感知,比传统方法快10倍以上。
Depth from Coupled Optical Differentiation

- 通过图像的光学微分对直接计算深度,无需复杂算法。
- 每像素仅需36次浮点运算,计算量低于此前最低水平十倍以上。
- 工作范围超传统方法两倍,适合低功耗设备部署。
我们提出了一种基于耦合光学微分的深度感知方法,这是一种低计算量的被动光照三维传感机制。该方法发现,通过一个简单且封闭形式的关系式,利用模糊图像的一对光学微分即可精确确定每个像素的物体距离。与以往依赖图像空间导数的深度模糊(DfD)方法不同,该机制仅使用光学微分,显著提高了抗噪能力。此外,该关系对多种光圈编码均具有普适性,无需特定光圈设计。我们构建了首个基于此原理的3D传感器,其光学结构包含可调透镜和电动光圈,支持动态调节光学功率与光圈半径。传感器采集两对图像:一对为光学功率微变,另一对为光圈尺度微变。从四幅图像中,仅需36次浮点运算(FLOPOP)即可生成深度图与置信度图,计算量低于已知最低被动光照深度感知方案的十倍以上。同时,该传感器生成的深度图工作范围超过以往DfD方法的两倍,且计算开销极低。
原文摘要 · Abstract (English)
We propose depth from coupled optical differentiation, a low-computation passive-lighting 3D sensing mechanism. It is based on our discovery that per-pixel object distance can be rigorously determined by a coupled pair of optical derivatives of a defocused image using a simple, closed-form relationship. Unlike previous depth-from-defocus (DfD) methods that leverage spatial derivatives of the image to estimate scene depths, the proposed mechanism's use of only optical derivatives makes it significantly more robust to noise. Furthermore, unlike many previous DfD algorithms with requirements on aperture code, this relationship is proved to be universal to a broad range of aperture codes. We build the first 3D sensor based on depth from coupled optical differentiation. Its optical assembly includes a deformable lens and a motorized iris, which enables dynamic adjustments to the optical power and aperture radius. The sensor captures two pairs of images: one pair with a differential change of optical power and the other with a differential change of aperture scale. From the four images, a depth and confidence map can be generated with only 36 floating point operations per output pixel (FLOPOP), more than ten times lower than the previous lowest passive-lighting depth sensing solution to our knowledge. Additionally, the depth map generated by the proposed sensor demonstrates more than twice the working range of previous DfD methods while using significantly lower computation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。