用文本+小特征向量压缩地图,定位精度不降反升。
SSR: A Generic Framework for Text-Aided Map Compression for Localization
- 用大模型压缩文本,搭配极小图像特征实现高效地图编码
- 在多个数据集上压缩率比现有方法高2倍,定位准确率更高
- 适合资源受限的机器人定位系统,尤其是远程部署场景
地图在机器人定位与下游决策中至关重要。随着机器人应用范围扩大,地图规模持续增长,导致存储、传输和云端查询带来巨大内存与带宽开销。本文提出一种文本增强型压缩框架,通过将文本作为可无损压缩的模态,结合轻量级文本描述与极小图像特征向量,构建紧凑的地图表示。核心思想是利用文本与图像特征的互补性。提出的相似性空间复制(SSR)技术,可在单次训练中学习到仅包含对文本补充信息的自适应图像嵌入。在多个下游定位任务中验证,包括视觉地点识别及室内外对象中心蒙特卡洛定位。在TokyoVal、Pittsburgh30k、Replica和KITTI等主流数据集上,该框架压缩效率比现有基线提升2倍,同时保持高保真定位性能。
原文摘要 · Abstract (English)
Mapping is crucial in robotics for localization and downstream decision-making. As robots are deployed in ever-broader settings, the maps they rely on continue to increase in size. However, storing these maps indefinitely (cold storage), transferring them across networks, or sending localization queries to cloud-hosted maps imposes prohibitive memory and bandwidth costs. We propose a text-enhanced compression framework that reduces both memory and bandwidth footprints while retaining high-fidelity localization. The key idea is to treat text as an alternative modality: one that can be losslessly compressed with large language models. We propose leveraging lightweight text descriptions combined with very small image feature vectors, which capture "complementary information" as a compact representation for the mapping task. Building on this, our novel technique, Similarity Space Replication (SSR), learns an adaptive image embedding in one shot that captures only the information "complementary" to the text descriptions. We validate our compression framework on multiple downstream localization tasks, including Visual Place Recognition as well as object-centric Monte Carlo localization in both indoor and outdoor settings. SSR achieves 2 times better compression than competing baselines on state-of-the-art datasets, including TokyoVal, Pittsburgh30k, Replica, and KITTI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。