arXiv:2410.19415eess.IVcs.CV2024-10被引 1

打通通信与计算成像壁垒,实现远程视觉高效感知

Integration of Communication and Computational Imaging

  • 联合优化传感与传输,全链路减少信息损失
  • 抗信道噪声更强,压缩率更高,实测30帧/秒27波段视频
  • 适合实时计算机视觉与远程感知场景

通信扩展了人类视觉在时空维度的感知能力,计算成像则突破了深度与广度的限制。尽管两者各自取得显著进展,但跨领域信息流通受阻,成为进一步发展的瓶颈。本文提出通信与计算成像融合框架(ICCI),打破二者固有隔离,实现远程感知。通过联合优化远端视觉信息的采集与传输,ICCI在全链路完成信息传递优化,最大限度减少从信息源生成到最终视觉任务执行过程中的信息损失。数值分析与实验验证表明,相比传统串行式感知-传输方案,ICCI在抗信道噪声和干扰方面表现更优,同时实现更高数据压缩比。实验成功实现了80公里外、27个波段、30帧每秒的高光谱视频感知。该新范式为各类实时计算机视觉任务提供了高效解决方案。

原文摘要 · Abstract (English)

Communication enables the expansion of human visual perception beyond the limitations of time and distance, while computational imaging overcomes the constraints of depth and breadth. Although impressive achievements have been witnessed with the two types of technologies, the occlusive information flow between the two domains is a bottleneck hindering their ulterior progression. Herein, we propose a novel framework that integrates communication and computational imaging (ICCI) to break through the inherent isolation between communication and computational imaging for remote perception. By jointly considering the sensing and transmitting of remote visual information, the ICCI framework performs a full-link information transfer optimization, aiming to minimize information loss from the generation of the information source to the execution of the final vision tasks. We conduct numerical analysis and experiments to demonstrate the ICCI framework by integrating communication systems and snapshot compressive imaging systems. Compared with straightforward combination schemes, which sequentially execute sensing and transmitting, the ICCI scheme shows greater robustness against channel noise and impairments while achieving higher data compression. Moreover, an 80 km 27-band hyperspectral video perception with a rate of 30 fps is experimentally achieved. This new ICCI remote perception paradigm offers a highefficiency solution for various real-time computer vision tasks.

远程感知计算成像通信融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。