arXiv:2603.10438cs.ROcs.CV2026-03

通过异步缓存机制,让单目深度估计在边缘设备上实时运行。

AsyncMDE: Real-Time Monocular Depth Estimation via Asynchronous Spatial Memory

  • 用后台慢速模型定期生成空间特征,前台快速路径异步复用
  • 在Jetson AGX Orin上达161 FPS,仅损失23%精度
  • 适合需要低延迟深度感知的机器人部署场景

基于基础模型的单目深度估计为机器人感知提供了主动传感器的可行替代方案,但其计算开销常阻碍在边缘平台的部署。现有方法对每帧独立推理,浪费了连续操作中相邻视角间的大量计算冗余。本文提出AsyncMDE,一个由冻结基础模型与轻量快速路径组成的异步深度感知系统,将基础模型的计算成本分摊到时间维度。基础模型周期性在后台生成高质量空间特征,而轻量快速路径在前台异步运行,通过互补融合将缓存记忆与当前观测结合,输出深度估计并自回归更新记忆,实现跨帧特征复用且精度下降可控。系统快路径仅含383万可训练参数,慢路径975万冻结参数,在RTX 4090上达到237 FPS,恢复了基础模型77%的精度差距。在室内静态、动态及合成极端运动基准测试中,性能退化可预测,经TensorRT优化后在Jetson AGX Orin上实现161 FPS快速推理,支持真实环境下的边缘实时部署。

原文摘要 · Abstract (English)

Foundation-model-based monocular depth estimation offers a viable alternative to active sensors for robot perception, yet its computational cost often prohibits deployment on edge platforms. Existing methods perform independent per-frame inference, wasting the substantial computational redundancy between adjacent viewpoints in continuous robot operation. This paper presents AsyncMDE, an asynchronous depth perception system consisting of a frozen foundation model and a lightweight fast path that amortizes the foundation model's computational cost over time. The foundation model periodically produces high-quality spatial features in the background, while the lightweight fast path runs asynchronously in the foreground, fusing cached memory with current observations through complementary fusion, outputting depth estimates, and autoregressively updating memory. This enables cross-frame feature reuse with bounded accuracy degradation. With 3.83M trainable fast-path parameters and a 97.5M frozen slow path, AsyncMDE's fast path operates at 237 FPS on an RTX 4090, recovering 77% of the accuracy gap to the foundation model. Across indoor static, dynamic, and synthetic extreme-motion benchmarks, AsyncMDE degrades predictably and reaches 161 FPS fast-path inference on a TensorRT-optimized Jetson AGX Orin, supporting real-time edge deployment.

单目深度边缘计算异步推理机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。