抗生物污损无镜头相机结合深度学习,实现长期水下清晰成像。
Anti-biofouling Lensless Camera System with Deep Learning based Image Reconstruction
- 采用带1000个矩形小孔的铜质薄板作为防污编码孔径。
- 通过ViT与门控MLP模型重建图像,克服无镜头模糊问题。
- 专为海水环境设计,可长期监控海上结构与养殖密度。
近年来,对长期监测海上结构状况及水产养殖环境中个体数量的水下摄像头需求日益增长。其中一个关键问题是生物污损会密集附着于光圈和镜头表面,阻碍摄像头捕捉清晰图像。本研究提出一种结合高抗生物污损材料技术与基于深度学习图像重建的无镜头相机系统。原型相机采用含1000个矩形小孔的薄铜板作为编码孔径,有效抑制生物污损生长并保持表面清洁。尽管无镜头相机因缺乏传统玻璃透镜导致成像质量差,但近期研究表明,使用视觉变换器(ViT)可良好重建原始照片图像;本研究也证实门控多层感知机(gated MLP)同样取得良好效果。然而,为实现防污功能,材料需具备一定厚度,而孔径又需远小于小孔尺寸以避免侧壁反射与吸收。因此,我们制备了足够薄的金属板以支持图像重建,并正在实际海水环境中测试该抗污型无镜头相机,评估其相比仅防水普通相机的生物污损抑制效果。
原文摘要 · Abstract (English)
In recent years, there has been an increasing demand for underwater cameras that monitor the condition of offshore structures and check the number of individuals in aqua culture environments with long-period observation. One of the significant issues with this observation is that biofouling sticks to the aperture and lens densely and prevents cameras from capturing clear images. This study examines an underwater camera that applies material technologies with high inherent resistance to biofouling and computer vision technologies based on image reconstruction by deep learning to lens-less cameras. For this purpose, our prototype camera uses a coded aperture with 1k rectangular shape pinholes in a thin metal plate, such as copper, which hinder the growth of biofouling and keep the surface clean. Although images taken by lens-less cameras are usually not well formed due to lack of the traditional glass-based lens, a deep learning approach using ViT (Vision Transformer) has recently demonstrated reconstructing original photo images well and our study shows that using gated MLP (Multilayer Perceptron) also yields good results. On the other hand, a certain degree of thickness for bio-repellence materials is required to exhibit their effect the thickness of aperture is necessary to use apertures sufficiently thinner than the size of the pinholes to avoid unintentional reflection and absorption on the sidewalls. Therefore, we prepared a sufficiently thin plate for image reconstruction and now currently we conduct tests of the lens-less camera of the bio-repellence aperture with actual seawater environments to determine whether it can sufficiently demonstrate the biofouling effect compared with usual camera with only waterproof.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。