arXiv:2409.06584cs.CV2024-09AAAI被引 3

动态补偿计算延迟,实现实时目标检测的自适应感知模型

Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perception

  • 用自适应延迟感知注意力机制,预测多个未来帧并择优输出
  • 在不同硬件上均实现最高检测精度,支持从V100到2080Ti全平台运行
  • 特别适合自动驾驶等对实时性要求极高的场景

实时目标检测对自动驾驶等实际应用中的避障与路径规划至关重要。本文提出Transtreaming,一种面向实时流式感知的新方法,解决动态计算延迟带来的挑战。其核心是自适应延迟感知的Transformer架构,可同时预测多个未来帧,并选择最匹配真实时间的输出,从而补偿系统计算延迟。该模型在单帧检测场景下也优于现有最优方法,得益于基于Transformer的设计。实验表明,Transtreaming在从强大V100到中等2080Ti的各类设备上均保持卓越性能,实现了全平台最高感知精度。相比多数先进方法在低性能设备上无法完成单帧计算,Transtreaming在所有设备上均满足严格实时处理需求。结果凸显了系统的强适应性,有望显著提升自动驾驶等实际系统的安全性与可靠性。

原文摘要 · Abstract (English)

Real-time object detection is critical for the decision-making process for many real-world applications, such as collision avoidance and path planning in autonomous driving. This work presents an innovative real-time streaming perception method, Transtreaming, which addresses the challenge of real-time object detection with dynamic computational delay. The core innovation of Transtreaming lies in its adaptive delay-aware transformer, which can concurrently predict multiple future frames and select the output that best matches the real-world present time, compensating for any system-induced computation delays. The proposed model outperforms the existing state-of-the-art methods, even in single-frame detection scenarios, by leveraging a transformer-based methodology. It demonstrates robust performance across a range of devices, from powerful V100 to modest 2080Ti, achieving the highest level of perceptual accuracy on all platforms. Unlike most state-of-the-art methods that struggle to complete computation within a single frame on less powerful devices, Transtreaming meets the stringent real-time processing requirements on all kinds of devices. The experimental results emphasize the system's adaptability and its potential to significantly improve the safety and reliability for many real-world systems, such as autonomous driving.

实时感知目标检测Transformer自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。