让机器人通过对话学习识别地点,无需访问对方模型或数据。
Multi-Robot Data-Free Continual Communicative Learning (CCL) from Black-Box Visual Place Recognition Models
- 用隐私攻击反向构造训练数据,实现黑盒模型间知识传递。
- 低通信成本下显著提升弱性能机器人的定位能力。
- 适合构建可扩展、抗故障的多机器人协作系统。
在新兴的多机器人社会中,异构智能体需持续通过通信提取并融合彼此的局部知识,即使其内部模型完全不透明。现有视觉定位(VPR)的持续或协作学习方法大多假设可访问模型参数或共享训练数据,这在机器人遇到未知同伴时并不现实。本文提出持续通信学习(CCL),一种无数据的多机器人框架:旅行机器人(学生)通过受限查询-响应通道与黑盒教师模型通信,持续提升自身VPR能力。我们重新利用原本用于隐私攻击的成员推断攻击(MIA),作为构建伪训练集的通信原语,无需访问模型参数或原始数据即可重建。为克服黑盒MIA固有的低采样效率瓶颈,提出基于学生自身VPR先验的查询策略,聚焦嵌入空间中信息丰富的区域,降低知识转移成本。在标准多会话VPR基准上的实验表明,该框架在有限通信预算下显著提升低性能机器人的表现,凸显其作为可扩展、容错多机器人系统的潜力。此外,我们提出分布式统计集成(DSI)框架,理论上消除灾难性遗忘,高效聚合黑盒VPR模型的充分统计量,同时保持数据隐私,并将通信开销降至样本无关的常数复杂度。
原文摘要 · Abstract (English)
In emerging multi-robot societies, heterogeneous agents must continually extract and integrate local knowledge from one another through communication, even when their internal models are completely opaque. Existing approaches to continual or collaborative learning for visual place recognition (VPR) largely assume white-box access to model parameters or shared training datasets, which is unrealistic when robots encounter unknown peers in the wild. This paper introduces \emph{Continual Communicative Learning (CCL)}, a data-free multi-robot framework in which a traveler robot (student) continually improves its VPR capability by communicating with black-box teacher models via a constrained query--response channel. We repurpose Membership Inference Attacks (MIA), originally developed as privacy attacks on machine learning models, as a constructive communication primitive to reconstruct pseudo-training sets from black-box VPR teachers without accessing their parameters or raw data. To overcome the intrinsic communication bottleneck caused by the low sampling efficiency of black-box MIA, we propose a prior-based query strategy that leverages the student's own VPR prior to focus queries on informative regions of the embedding space, thereby reducing the knowledge transfer (KT) cost. Experimental results on a standard multi-session VPR benchmark demonstrate that the proposed CCL framework yields substantial performance gains for low-performing robots under modest communication budgets, highlighting CCL as a promising building block for scalable and fault-tolerant multi-robot systems. Furthermore, we propose a Distributed Statistic Integration (DSI) framework that theoretically eliminates catastrophic forgetting by efficiently aggregating sufficient statistics from black-box VPR models while maintaining data privacy and reducing communication overhead to a sample-invariant constant complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。