模仿章鱼用单色传感器感知颜色，实现无滤镜光谱成像。
Seeing like a Cephalopod: Colour Vision with a Monochrome Event Camera
- 用球透镜与事件相机结合，通过焦点移动模拟章鱼视觉机制。
- 在可见光到近红外范围内实现波长依赖聚焦，分辨率达100 nm。
- 无需彩色滤镜或图像插值，适合低功耗、高速光谱传感场景。
章鱼虽仅具一种感光细胞，却能通过眼球光学结构与瞳孔形状引发的色差来辨别颜色。受此生物机制启发，我们设计了一种结合球透镜与事件相机的光谱成像系统。该系统采用可调焦距的机械装置，模拟章鱼自适应调焦行为，在可见光至近红外波段实现波长相关的聚焦，使事件信号成为光谱传感器。我们通过事件与传统帧式传感器对比，验证了该方法在仿真与真实环境中的有效性，并评估其光谱分辨性能。该方法无需传统彩色滤镜或计算去马赛克，提供了一种鲁棒的光谱感知能力。相关代码与分析已公开于：https://samiarja.github.io/neuromorphic_octopus_eye/
原文摘要 · Abstract (English)
Cephalopods exhibit unique colour discrimination capabilities despite having one type of photoreceptor, relying instead on chromatic aberration induced by their ocular optics and pupil shapes to perceive spectral information. We took inspiration from this biological mechanism to design a spectral imaging system that combines a ball lens with an event-based camera. Our approach relies on a motorised system that shifts the focal position, mirroring the adaptive lens motion in cephalopods. This approach has enabled us to achieve wavelength-dependent focusing across the visible light and near-infrared spectrum, making the event a spectral sensor. We characterise chromatic aberration effects, using both event-based and conventional frame-based sensors, validating the effectiveness of bio-inspired spectral discrimination both in simulation and in a real setup as well as assessing the spectral discrimination performance. Our proposed approach provides a robust spectral sensing capability without conventional colour filters or computational demosaicing. This approach opens new pathways toward new spectral sensing systems inspired by nature's evolutionary solutions. Code and analysis are available at: https://samiarja.github.io/neuromorphic_octopus_eye/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。