光电子芯片实现超高速低功耗图像压缩,性能远超传统电子方案。
End-to-end image compression and reconstruction with ultrahigh speed and ultralow energy enabled by opto-electronic computing processor
- 用硅光子芯片构建可编程压缩矩阵,支持2-256倍灵活压缩
- 每像素仅49.5皮秒延迟,耗能低于10.6纳焦,提升两到三个数量级
- 适用于航拍等海量图像实时处理,适合高算力低功耗场景
AR/VR、遥感、卫星雷达和医疗设备的快速发展,对超越电子处理器能力的超高效图像压缩与重建提出了迫切需求。本文首次展示了一种基于光电子计算芯片的端到端图像压缩与重建方法,实现了比电子方案高数个数量级的速度和更低的能耗。核心为一块32×32的硅光子计算芯片,单片集成32个高速调制器、32个探测器和可编程光矩阵核心,并与所有必要控制电路(TIA、ADC、DAC、FPGA等)共封装。利用光矩阵核心的可编程性,生成可训练的压缩矩阵,实现2-256倍可调压缩比,满足多样化应用需求。通过部署定制的轻量级光子集成电路网络(LiPICO-Net),实现了高质量压缩图像重建。系统端到端延迟仅为49.5皮秒/像素,功耗低于10.6纳焦/像素,相较当前最先进GPU上的经典模型提升2-3个数量级。我们在1.3亿像素航拍图像上验证了该系统,实现了电子系统因功耗与延迟限制而无法胜任的实时压缩。这项工作不仅为大规模图像处理提供了变革性解决方案,也为光子计算应用开辟了新路径。
原文摘要 · Abstract (English)
The rapid development of AR/VR, remote sensing, satellite radar, and medical equipment has created an imperative demand for ultra efficient image compression and reconstruction that exceed the capabilities of electronic processors. For the first time, we demonstrate an end to end image compression and reconstruction approach using an optoelectronic computing processor,achieving orders of magnitude higher speed and lower energy consumption than electronic counterparts. At its core is a 32X32 silicon photonic computing chip, which monolithically integrates 32 high speed modulators, 32 detectors, and a programmable photonic matrix core, copackaged with all necessary control electronics (TIA, ADC, DAC, FPGA etc.). Leveraging the photonic matrix core programmability, the processor generates trainable compressive matrices, enabling adjustable image compression ratios (from 2X to 256X) to meet diverse application needs. Deploying a custom lightweight photonic integrated circuit oriented network (LiPICO-Net) enables high quality reconstruction of compressed images. Our approach delivers an end to end latency of only 49.5ps/pixel while consuming only less than 10.6nJ/pixel-both metrics representing 2-3 orders of magnitude improvement compared with classical models running on state-of-the-art GPUs. We validate the system on a 130 million-pixel aerial imagery, enabling real time compression where electronic systems falter due to power and latency constraints. This work not only provides a transformative solution for massive image processing but also opens new avenues for photonic computing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。