用图像压缩记忆实现长期导航,让机器人像人一样记住并高效利用视觉经验。
AstraNav-Memory: Contexts Compression for Long Memory
- 用视觉上下文压缩模块将图像编码为少量令牌,实现高效长时记忆
- 在GOAT-Bench和HM3D-OVON上达到领先导航性能,熟悉环境路径更短
- 16倍压缩下每图仅需约30个令牌,支持数百张图像的记忆容量
持续体感导航需要智能体在任务间积累、保留并利用空间语义经验,以实现新环境中的高效探索和旧环境中的快速寻路。现有以物体为中心的记忆依赖检测与重建流程,限制了鲁棒性与可扩展性。本文提出一种图像中心的记忆框架,通过端到端的视觉上下文压缩模块与基于Qwen2.5-VL的导航策略结合,实现长期隐式记忆。该框架基于冻结的DINOv3特征的ViT主干网络,采用轻量级PixelUnshuffle+Conv模块作为视觉分词器,支持可配置压缩率;例如在16×压缩设置下,每张图像仅需约30个令牌,使有效上下文容量从数十张扩展至数百张。在GOAT-Bench和HM3D-OVON上的实验表明,该方法显著提升导航性能,在陌生环境探索效率更高,熟悉环境路径更短。消融实验进一步显示,适度压缩在效率与精度间取得最佳平衡。结果表明,压缩后的图像中心记忆是持久体感智能体的实用且可扩展接口,使其能够基于长期视觉历史进行推理,并以类人效率导航。
原文摘要 · Abstract (English)
Lifelong embodied navigation requires agents to accumulate, retain, and exploit spatial-semantic experience across tasks, enabling efficient exploration in novel environments and rapid goal reaching in familiar ones. While object-centric memory is interpretable, it depends on detection and reconstruction pipelines that limit robustness and scalability. We propose an image-centric memory framework that achieves long-term implicit memory via an efficient visual context compression module end-to-end coupled with a Qwen2.5-VL-based navigation policy. Built atop a ViT backbone with frozen DINOv3 features and lightweight PixelUnshuffle+Conv blocks, our visual tokenizer supports configurable compression rates; for example, under a representative 16$\times$ compression setting, each image is encoded with about 30 tokens, expanding the effective context capacity from tens to hundreds of images. Experimental results on GOAT-Bench and HM3D-OVON show that our method achieves state-of-the-art navigation performance, improving exploration in unfamiliar environments and shortening paths in familiar ones. Ablation studies further reveal that moderate compression provides the best balance between efficiency and accuracy. These findings position compressed image-centric memory as a practical and scalable interface for lifelong embodied agents, enabling them to reason over long visual histories and navigate with human-like efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。