仅用58万可训练参数实现高效视觉导航,性能媲美大模型。
Learning to Navigate Efficiently with Only 0.58M Trainable Parameters

- 将导航分解为解析计算与小模型结合,仅训练0.58M参数
- 在6060个任务中接近顶尖模型表现,碰撞率最低
- 适合资源受限场景,故障可分析修复
视觉导航近年依赖大规模模型与数据:端到端策略通常拥有数亿参数,在数十亿帧或大规模模拟数据上训练。本文探究单一任务家族实际需要多少规模,并寻找替代方案。提出一种分解式导航模型:将投影几何、占据关系和坐标变换等已知结构以解析方式计算,作为三个小型学习模块的接口。这三个模块分别是:将目标定位为当前视图局部子目标的出入口预测器、估计轨迹后验分布的导航预测器,以及基于终点约束的残差扩散生成器,从该后验采样轨迹形状。整个系统仅训练2270万总参数中的0.58万,使用4.4万帧数据,不到1个GPU小时即可完成训练,但在6060个点目标任务与60个环境上表现接近最先进水平,可训练参数减少233倍,碰撞率低于所有对比方法,且在Jetson Xavier NX上推理速度超10 Hz。该结构还可通过仅重训12.3万参数的出入口头,扩展至无目标探索;在传感器损坏时,其失效模式透明且可解析修正。
原文摘要 · Abstract (English)
Recent progress in visual navigation has largely been driven by scale: end-to-end policies with hundreds of millions of parameters trained on billions of frames or large-scale simulated data. We ask how much of this scale a single task family actually requires, and what structure can substitute for it. We propose a decomposed navigation model in which operations with known closed-form structure, such as projective geometry, occupancy, and coordinate transforms, are computed analytically and serve as interfaces between three small learned modules: an egress predictor that grounds the episode goal as a local subgoal in the current view, a navigation predictor that estimates a goal-conditioned posterior over where trajectories travel, and an endpoint-pinned residual diffusion generator that samples trajectory shapes from this posterior. The system trains only 0.58M out of a total of 22.7M parameters, on 44k frames in under one GPU-hour, yet approaches the performance of state-of-the-art models on navigation tasks across 6060 point-goal episodes and 60 environments, while having 233$\times$ fewer trainable parameters, the lowest collision rate among all evaluated methods, and 10+ Hz inference rate on a Jetson Xavier NX. The decomposition further transfers to no-goal exploration by retraining only the 123k-parameter egress head, and its failure modes under sensor corruption are transparent and analytically correctable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。