arXiv:2605.10251cs.CV2026-05

用图神经网络提升单目深度估计,速度更快且更准。

Efficient Hybrid CNN-GNN Architecture for Monocular Depth Estimation

论文配图:Efficient Hybrid CNN-GNN Architecture for Monocular Depth Estimation
图 1 · 摘自论文原文
  • 在卷积网络中加入多尺度图神经层,捕捉远距离空间关系。
  • 实测速度达25帧/秒,显存仅3.8GB,比主流模型快三倍。
  • 适合需要高效深度感知的无人机、机器人等实时场景应用。

我们提出GraphDepth,一种将图神经网络(GNN)融入卷积编码器-解码器框架的单目深度估计架构。通过在ResNet-101 U-Net骨干网络的多个尺度(1/32、1/16、1/8分辨率)嵌入高效的GraphSAGE层,显式建模超出局部卷积感受野的长程空间关系。关键技术包括:(1) 可配置的k-NN与网格邻接的批处理并行图构建,支持高效训练;(2) 在瓶颈层和解码器阶段集成多尺度GraphSAGE,实现全局上下文在整个特征层级的传播;(3) 通道注意力门控跳跃连接,自适应加权编码器特征后融合;(4) 通过专用的异方差不确定性头进行非确定性不确定性估计,支持优化过程中的置信度加权损失。相比基于变换器的混合模型,GraphDepth在空间分辨率上呈线性扩展,而变换器为二次复杂度,同时达到相当的全局感受野。在NYU Depth V2、WHU Aerial、ETH3D和Mid-Air基准测试中,其室内场景精度优于当前最先进变换器模型的4.6%以内,计算成本显著更低(25 FPS vs 9 FPS,3.8 GB vs 8.8 GB VRAM)。GraphDepth在WHU Aerial数据集上取得最优结果(RMSE 8.24 m),并在零样本跨域迁移至合成航拍数据集Mid-Air时表现优异,验证了显式关系推理在深度估计中的泛化能力。

原文摘要 · Abstract (English)

We present GraphDepth, a monocular depth estimation architecture that synergistically integrates Graph Neural Networks (GNNs) within a convolutional encoder-decoder framework. Our approach embeds efficient GraphSAGE layers at multiple scales of a ResNet-101 U-Net backbone, enabling explicit modeling of long-range spatial relationships that lie beyond the receptive field of local convolutions. Key technical contributions include: (1) batch-parallelized graph construction with configurable k-NN and grid-based adjacency for scalable training; (2) multi-scale GraphSAGE integration at bottleneck and decoder stages (1/32, 1/16, 1/8 resolution) to propagate global context throughout the feature hierarchy; (3) channel-attention gated skip connections that adaptively weight encoder features before fusion; and (4) heteroscedastic uncertainty estimation via a dedicated aleatoric uncertainty head, enabling confidence-aware loss weighting during optimization. Unlike transformer-based hybrids, which suffer from quadratic complexity in sequence length, GraphDepth scales linearly with spatial resolution while achieving comparable global receptive fields through iterative message passing. Experiments on NYU Depth V2, WHU Aerial, ETH3D, and Mid-Air benchmarks demonstrate competitive accuracy within 4.6\% of state-of-the-art transformers on indoor scenes with substantially lower computational cost (25 FPS vs 9 FPS, 3.8 GB vs 8.8 GB VRAM). GraphDepth achieves the best reported result on WHU Aerial (RMSE 8.24 m) and exhibits superior zero-shot cross-domain transfer to the Mid-Air synthetic aerial dataset, validating the generalization power of explicit relational reasoning for depth estimation.

深度估计图神经网络轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。