对比神经3D重建在不同硬件上的实时性能,为实验室机器人提供分级感知方案。
Cross-Platform Benchmark of Neural 3D Reconstruction for Autonomous Laboratory Robots

- 在从单板计算机到服务器的多种设备上测试NeRF与3D高斯泼溅的训练渲染性能。
- 高斯泼溅质量更高但显存消耗更大,机载计算无法满足交互级全场景优化需求。
- 单图重建模型SAM3D秒级输出几何,但细节偏差影响后续操作,适合轻量级实时感知。
自主实验室机器人依赖3D重建流水线,将原始摄像头流转化为物理控制环内可行动作的物体表征,且需满足延迟预算。神经3D重建方法虽能实现高质量视图合成,但其在实际运行实验室机器人的计算平台上的实时可行性仍缺乏系统评估。本文对神经3D重建方法进行系统性算力平台基准测试,评估了NeRF与3D高斯泼溅在从单板计算机到服务器级节点的各类GPU设备上的训练与渲染表现,并将Meta的SAM3D单图像重建置于同一评估轴上,量化其相对于逐场景优化的延迟与保真度差距。结果表明,高斯泼溅在更高显存开销下获得优于NeRF的渲染质量,而机载计算无法支持交互速率下的全场景优化。初步评估显示,SAM3D可在数秒内生成合理物体几何,但存在细节失配,可能影响下游操作。这些发现推动构建分层重建流水线:轻量级前馈重建维持实时感知与跟踪,更重的神经重建则按需调度至合适算力资源。
原文摘要 · Abstract (English)
Autonomous robots performing laboratory tasks depend on 3D reconstruction pipelines that can turn raw camera streams into actionable object representations within the latency budget of a physical control loop. Neural 3D reconstruction methods have demonstrated high-quality view synthesis, but their real-time viability across the compute platforms on which laboratory robots actually run remains poorly characterized. In this work, we present a systematic compute-platform benchmark of neural 3D reconstruction methods, evaluating NeRF and 3D Gaussian Splatting training and rendering on GPU-enabled computing devices ranging from single-board computers to server-class nodes, and place Meta's SAM3D single-image reconstruction on the same axes to quantify its latency and fidelity gap relative to per-scene optimization. Our results show that Gaussian Splatting yields higher rendering quality than NeRF at greater GPU cost, and that onboard compute is insufficient for full per-scene optimization at interactive rates. Our preliminary assessment on SAM3D indicates that it delivers plausible object geometry within seconds, but with detail mismatches that can compromise downstream manipulation. Together, these findings motivate tiered pipelines in which lightweight feed-forward reconstruction sustains the real-time perception-and-tracking loop for laboratory robots, while heavier neural reconstruction is scheduled selectively on suitable compute.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。