用事件光场相机在强湍流中高速成像,突破传统限制。
High-speed Imaging through Turbulence with Event-based Light Fields
- 结合事件相机与多视角光场,分离运动与湍流信号。
- 实测可在强湍流下捕捉速度达16000像素/秒的物体。
- 适合高速视觉、湍流成像领域研究者参考。
本文首次展示了能够在强大气湍流中以高帧率成像快速移动的非刚性扩展物体的系统。事件相机是一种新型传感架构,可实现每秒数千帧的高速成像。然而,仅靠事件相机无法区分场景运动与湍流影响。本工作通过事件光场相机和基于机器学习的重建算法克服此局限:通过同时捕捉场景多个视角,事件光场相机能区分由运动引起的动态(跨视角事件高度相关)与湍流引起的动态(跨视角事件弱相关)。桌面实验表明,该系统可在强湍流条件下成像速度高达16,000像素/秒的物体。
原文摘要 · Abstract (English)
This work introduces and demonstrates the first system capable of imaging fast-moving extended non-rigid objects through strong atmospheric turbulence at high frame rate. Event cameras are a novel sensing architecture capable of estimating high-speed imagery at thousands of frames per second. However, on their own event cameras are unable to disambiguate scene motion from turbulence. In this work, we overcome this limitation using event-based light field cameras: By simultaneously capturing multiple views of a scene, event-based light field cameras and machine learning-based reconstruction algorithms are able to disambiguate motion-induced dynamics, which produce events that are strongly correlated across views, from turbulence-induced dynamics, which produce events that are weakly correlated across view. Tabletop experiments demonstrate event-based light field can overcome strong turbulence while imaging high-speed objects traveling at up to 16,000 pixels per second.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。