用可学习的分光金属透镜实现可见光宽带无遮挡成像
Learned split-spectrum metalens for obstruction-free broadband imaging in the visible
- 将RGB通道分频段过滤,远物成像走通带,近物遮挡光被滤除
- 相比传统设计,图像质量提升32.29% PSNR,目标检测准确率增13.54% mAP
- 适合移动机器人、无人机、内窥镜等空间受限设备使用
雨滴、栅栏或灰尘等遮挡物会降低成像质量,尤其在无法机械清洁时。传统解决方案依赖笨重复合镜头阵列或计算修复,牺牲紧凑性或保真度。由亚波长超原子组成的金属透镜可实现紧凑成像,但同时实现宽带与无遮挡成像仍是难题,因金属透镜对远距离场景宽谱成像时,无法正确失焦近距遮挡物。本文提出一种可学习的分光金属透镜,实现宽带无遮挡成像。方法将每个RGB通道光谱分为通带与阻带,通过多频段光谱滤波,使远物光线经通带聚焦,而近物聚焦光则被阻带过滤。光学信号再经神经网络增强。该设计在相对PSNR上提升32.29%,物体检测与语义分割准确率分别提升+13.54% mAP、+48.45% IoU和+20.35% mIoU,优于传统双曲设计。为移动机器人、无人机及内窥镜等空间受限系统提供鲁棒无遮挡感知与视觉能力。
原文摘要 · Abstract (English)
Obstructions such as raindrops, fences, or dust degrade captured images, especially when mechanical cleaning is infeasible. Conventional solutions to obstructions rely on a bulky compound optics array or computational inpainting, which compromise compactness or fidelity. Metalenses composed of subwavelength meta-atoms promise compact imaging, but simultaneous achievement of broadband and obstruction-free imaging remains a challenge, since a metalens that images distant scenes across a broadband spectrum cannot properly defocus near-depth occlusions. Here, we introduce a learned split-spectrum metalens that enables broadband obstruction-free imaging. Our approach divides the spectrum of each RGB channel into pass and stop bands with multi-band spectral filtering and learns the metalens to focus light from far objects through pass bands, while filtering focused near-depth light through stop bands. This optical signal is further enhanced using a neural network. Our learned split-spectrum metalens achieves broadband and obstruction-free imaging with relative PSNR gains of 32.29% and improves object detection and semantic segmentation accuracies with absolute gains of +13.54% mAP, +48.45% IoU, and +20.35% mIoU over a conventional hyperbolic design. This promises robust obstruction-free sensing and vision for space-constrained systems, such as mobile robots, drones, and endoscopes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。