用无源超材料实现低功耗非线性图像处理,突破光照强度极限。
High-resolution and ultra-low power nonlinear image processing with passive high-quality factor metasurfaces
- 利用硅纳米天线阵列实现无外部供电的全光学非线性处理
- 实验阈值低至0.1 mW/μm²,空间分辨率达1.85 μm
- 适合高能效图像传感与边缘计算场景
图像处理既是人工智能应用最活跃的领域之一,也是计算开销最大的任务。纳米结构超表面通过在探测前以超薄层直接处理环境光图像数据,为极致节能开辟了新路径。然而,通用计算的关键组件——非线性阈值函数,在低光强下仍无法实现无外接电源的运作。本文提出一种被动、全光学的非线性图像处理方法,基于硅纳米天线阵列,实验演示了一维图像处理仅需瓦级功率。通过利用高Q值导模共振带来的光热克尔非线性,实现了最低0.1 mW/μm²的实验阈值,空间分辨率达1.85 μm。额外仿真表明,阈值可进一步降低,同时保持高空间选择性。模拟的像素级、平滑漏失修正线性单元(leaky ReLU)激活滤波器,有望彻底改变图像传感范式。
原文摘要 · Abstract (English)
Image processing is both one of the most exciting domains for applying artificial intelligence and the most computationally expensive. Nanostructured metasurfaces have opened the door to the ultimate energy saving by directly processing ambient image data via ultra-thin layers before detection. However, a key ingredient of universal computation - nonlinear thresholding functions - have yet to be demonstrated for low intensities without an external power source. Here, we present a passive, all-optical method for nonlinear image processing using Silicon nanoantenna arrays. We experimentally demonstrate an intensity thresholding filter capable of processing one-dimensional images with only Watt-level power. By leveraging the opto-thermal Kerr nonlinearity through high-Q guided mode resonance, we achieve an experimental threshold as low as 0.1 mW/μm^2 with a spatial resolution of 1.85 μm. Additional simulations indicate that the threshold can be further reduced while maintaining high spatial selectivity. Analog, pixel-wise, smoothed leaky ReLU activation filters promise to revolutionize image sensing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。