arXiv:2510.25314cs.CVcs.RO2025-10

用仿生球形镜头+联合重建算法,实现紧凑高保真深度成像。

Seeing Clearly and Deeply: An RGBD Imaging Approach with a Bio-inspired Monocentric Design

  • 仿生全球面镜头自然编码深度信息,无需复杂光学元件。
  • 深度估计绝对相对误差0.026,图像结构相似性达0.960。
  • 适合需要小型化高精度深度感知的智能设备研发者。

实现高保真、紧凑型RGBD成像面临双重挑战:传统紧凑光学在全景深范围内难以保持RGB清晰度,而纯软件单目深度估计依赖不可靠语义先验,属病态问题。尽管深度光学(如DOEs)可编码深度,但会带来制造复杂性和色差问题。为此,本文提出一种新型生物启发式全球面单中心镜头,并构建了整体协同设计的仿生单中心成像(BMI)框架。该光学设计通过深度相关的点扩散函数(PSFs)自然编码深度信息,无需复杂衍射或自由曲面元件。我们建立严格的物理驱动前向模型,精确模拟光学退化过程以生成合成数据集。该仿真流程与双头多尺度重建网络协同设计,共享编码器联合恢复高保真全聚焦图像和精确深度图。大量实验验证了该框架的最先进性能:深度估计达到绝对相对误差0.026、均方根误差0.130,显著优于主流软件方法与其他深度光学系统;图像复原方面,结构相似性达0.960,感知损失LPIPS为0.082,证明了图像保真度与深度精度之间的优异平衡。本研究表明,生物启发的全球面光学与联合重建算法的结合,是应对高性能紧凑型RGBD成像固有挑战的有效策略。源代码将公开于https://github.com/ZongxiYu-ZJU/BMI。

原文摘要 · Abstract (English)

Achieving high-fidelity, compact RGBD imaging presents a dual challenge: conventional compact optics struggle with RGB sharpness across the entire depth-of-field, while software-only Monocular Depth Estimation (MDE) is an ill-posed problem reliant on unreliable semantic priors. While deep optics with elements like DOEs can encode depth, they introduce trade-offs in fabrication complexity and chromatic aberrations, compromising simplicity. To address this, we first introduce a novel bio-inspired all-spherical monocentric lens, around which we build the Bionic Monocentric Imaging (BMI) framework, a holistic co-design. This optical design naturally encodes depth into its depth-varying Point Spread Functions (PSFs) without requiring complex diffractive or freeform elements. We establish a rigorous physically-based forward model to generate a synthetic dataset by precisely simulating the optical degradation process. This simulation pipeline is co-designed with a dual-head, multi-scale reconstruction network that employs a shared encoder to jointly recover a high-fidelity All-in-Focus (AiF) image and a precise depth map from a single coded capture. Extensive experiments validate the state-of-the-art performance of the proposed framework. In depth estimation, the method attains an Abs Rel of 0.026 and an RMSE of 0.130, markedly outperforming leading software-only approaches and other deep optics systems. For image restoration, the system achieves an SSIM of 0.960 and a perceptual LPIPS score of 0.082, thereby confirming a superior balance between image fidelity and depth accuracy. This study illustrates that the integration of bio-inspired, fully spherical optics with a joint reconstruction algorithm constitutes an effective strategy for addressing the intrinsic challenges in high-performance compact RGBD imaging. Source code will be publicly available at https://github.com/ZongxiYu-ZJU/BMI.

RGBD成像仿生光学深度估计图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。