将红外成像与目标检测融合,实现低延迟实时检测。
Dual-Integrated Low-Latency Single-Lens Infrared Computational Imaging for Object Detection

- 用物理先验融合重建与检测网络,共享特征避免重复计算。
- 在低信噪比下推理速度提升84.06%,检测精度提高5.07%。
- 适合嵌入式设备部署,系统重量减少50%。
计算成像使紧凑型红外系统成为可能,但现有深度学习流水线将图像重建与目标检测结合时引入显著推理延迟。多数加速策略压缩重建网络,却忽略光学路径中的物理先验,导致精度与速度难以兼顾。本文提出物理感知双集成网络(PDI-Net),将红外重建与目标检测一体化,并将光学先验嵌入学习过程。训练阶段采用监督式U-Net,推理时半U-Net编码器直接共享特征给基于YOLO的检测器,避免完整重建。为弥合保真度导向的重建特征与检测语义间的差距,引入物理感知大小桥(PALS-Bridge),利用依赖场的点扩散函数先验自适应调制多尺度卷积分支。同时构建物理驱动的光学退化仿真流程用于训练与验证。该方法部署于单透镜红外相机,在低信噪比条件下相比剪枝策略的Rec+Det推理时间减少84.06%,[email protected]:0.95提升5.07%,系统重量较传统多透镜设计降低约50%。结果表明,该框架可实现在资源受限平台上的紧凑、低延迟计算红外成像与实时目标检测。
原文摘要 · Abstract (English)
Computational imaging enables compact infrared systems, but deep-learning pipelines that combine image reconstruction and object detection often introduce substantial inference latency. Most existing acceleration strategies compress the reconstruction network while overlooking physical priors from the optical path, leaving a trade-off between accuracy and speed. We present Physics-aware Dual-Integrated Network (PDI-Net), a low-latency framework that integrates infrared reconstruction with object detection and further embeds optical priors into the learning process. PDI-Net uses a supervised U-Net during training, while a semi-U-Net encoder shares features directly with a YOLO-based detector during inference, avoiding full image reconstruction. To bridge the gap between fidelity-oriented reconstruction features and detection-oriented semantics, we introduce a physics-aware large-small bridge (PALS-Bridge), which uses field-dependent point spread function priors to adaptively modulate multiscale convolutional branches. A physics-informed optical degradation simulation pipeline is also developed for training and validation. The method is deployed on a single-lens infrared camera, reducing system weight by about 50% compared with traditional multi-lens designs. On the M3FD benchmark under low-SNR conditions, PDI-Net reduces inference time by 84.06% compared with the Rec+Det with pruning strategy while improving [email protected]:0.95 by 5.07%. These results demonstrate compact, low-latency computational infrared imaging for real-time object detection on resource-constrained platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。