用单次视频生成3D高斯图,让机器人无地图导航
YOPO-Nav: Visual Navigation using 3DGS Graphs from One-Pass Videos
- 用3D高斯点云构建环境的紧凑空间图谱
- 在真实机器人上实现4小时视频路径重演,成功率超90%
- 适合做视觉导航与场景表示研究的开源数据集
视觉导航正成为传统依赖详细建图与路径规划的机器人导航方案的实用替代。然而,构建和维护3D地图通常计算开销大且内存占用高。本文针对可获取大型环境探索视频的情况,提出一种无需依赖度量地图的导航方法。所提方法YOPO-Nav(You Only Pass Once)将环境编码为由相互连接的局部3D高斯泼溅(3DGS)模型构成的紧凑空间表示。导航时,系统将当前视觉观测与该表示对齐,并预测引导机器人返回示范轨迹的动作。采用分层设计:视觉位置识别(VPR)模块提供粗粒度定位,局部3DGS模型则细化目标与中间位姿以生成控制动作。为评估方法,我们构建了YOPO-Campus数据集,包含超过6公里人工遥控机器人轨迹的4小时第一人称视频及控制器输入。在Clearpath Jackal机器人上对近期视觉导航方法进行基准测试,结果表明,YOPO-Nav在真实场景图像目标导航任务中表现优异。代码与数据集将公开,供视觉导航与场景表征研究使用。
原文摘要 · Abstract (English)
Visual navigation has emerged as a practical alternative to traditional robotic navigation pipelines that rely on detailed mapping and path planning. However, constructing and maintaining 3D maps is often computationally expensive and memory-intensive. We address the problem of visual navigation when exploration videos of a large environment are available. The videos serve as a visual reference, allowing a robot to retrace the explored trajectories without relying on metric maps. Our proposed method, YOPO-Nav (You Only Pass Once), encodes an environment into a compact spatial representation composed of interconnected local 3D Gaussian Splatting (3DGS) models. During navigation, the framework aligns the robot's current visual observation with this representation and predicts actions that guide it back toward the demonstrated trajectory. YOPO-Nav employs a hierarchical design: a visual place recognition (VPR) module provides coarse localization, while the local 3DGS models refine the goal and intermediate poses to generate control actions. To evaluate our approach, we introduce the YOPO-Campus dataset, comprising 4 hours of egocentric video and robot controller inputs from over 6 km of human-teleoperated robot trajectories. We benchmark recent visual navigation methods on trajectories from YOPO-Campus using a Clearpath Jackal robot. Experimental results show YOPO-Nav provides excellent performance in image-goal navigation for real-world scenes on a physical robot. The dataset and code will be made publicly available for visual navigation and scene representation research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。