仅用少量数据即可让机器人快速适应未知触觉传感器。
BIFTA: Brain-Inspired Few-Shot Tactile Adaptation for Unknown Sensors

- 模仿大脑快速适应机制,用小样本实现触觉模型跨传感器迁移。
- 在未知传感器上将准确率从6.86%提升至87.09%,超越现有方法47.22个百分点。
- 适合需要高效适配新硬件的机器人触觉系统研发人员使用。
触觉传感技术的进步使富含接触信息的感知成为可能,推动了机器人操作、材料理解与具身交互的发展。然而,由于光学设计、弹性体力学和成像几何差异显著,基于已知传感器训练的模型在未知传感器上会性能骤降。为此,我们提出脑启发式少样本触觉自适应框架(BIFTA):借鉴大脑快速感官适应机制,仅用少量标注支持集,即可将冻结编码器适配到未知触觉传感器。BIFTA通过双视图统计记忆保留预训练表征,构建支持条件谱图修复传感器相关的特征邻域,并采用不确定性门控循环传播强化可靠的跨查询证据。在三个触觉数据集上的广泛基准测试表明,BIFTA显著提升了对未知传感器的适应能力:在SITR数据集上仅使用10%目标数据标签,平均Sparsh准确率从冻结源分类器的6.86%提升至87.09%,优于最强基线47.22个百分点,且效果在数据集、预训练主干网络和触觉任务间具有泛化性。结果验证了BIFTA在低数据成本下适配未知触觉传感器的有效性,为跨异构硬件的触觉模型迁移提供了可行路径。
原文摘要 · Abstract (English)
Advances in tactile sensing have made contact-rich perception possible, accelerating progress in robotic manipulation, material understanding, and embodied interaction. However, because optical design, elastomer mechanics, and imaging geometry differ substantially across tactile sensors, models trained on known sensor types can suffer an abrupt performance collapse on unknown sensors. To address this problem, we propose the Brain-Inspired Few-Shot Tactile Adaptation (BIFTA) framework; it draws on the brain's rapid sensory adaptation mechanism to adapt a frozen encoder to an unknown tactile sensor from a small labeled support set. BIFTA preserves pretrained representations through dual-view statistical memory, constructs support-conditioned spectral graphs to repair sensor-dependent feature neighborhoods, and applies uncertainty-gated recurrent propagation to strengthen reliable cross-query evidence. Extensive benchmarks across three tactile datasets show that BIFTA substantially improves adaptation to unknown sensors: with only 10\% labeled target data on SITR, it raises mean Sparsh accuracy from 6.86\% for the frozen source classifier to 87.09\%, exceeding the strongest implemented prior comparison by 47.22 percentage points, and these gains generalize across datasets, pretrained backbones, and tactile tasks. These results validate BIFTA for data-efficient adaptation to unknown tactile sensors and offer a promising route toward tactile models that transfer across heterogeneous hardware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。