arXiv:2608.04043cs.LGcs.RO2026-08

用廉价压力传感器实现开放词汇物体识别,效果媲美专业模型。

Tactus: Open-Vocabulary Object Recognition from Low-Cost Pressure Arrays

论文配图:Tactus: Open-Vocabulary Object Recognition from Low-Cost Pressure Arrays
图 1 · 摘自论文原文
  • 仅用压力数据+自编码预训练,无需标签即可识别物体
  • 在27类物体上准确率达0.771,接近监督模型表现
  • 适合低成本触觉系统研究者,支持文本查询与跨传感器泛化

电阻式压力阵列是成本最低、出货量最大的触觉传感器,但触觉表征学习长期聚焦于成像凝胶的光学传感器。本文提出Tactus,一种仅基于压力数据回答文本查询的开放模型:在STAG基准(27个物体,未见录制数据)上,其四次运行的Top-1准确率为0.771±0.062(Top-3为0.935),达到甚至超过该数据集监督闭集CNN的0.76表现,且无需训练分类头。方法采用小样本策略:187个训练录音,14.4万帧无标签同传感器数据进行掩码自编码预训练,结合传感器自身校准仿射变换,该步骤提升的准确率超过所有架构调整总和。模型错误集中于少数接触模糊类别,与文本目标几何无关(702类对中斯皮尔曼相关系数≤0.05),在改写或仅名称查询下仍保持稳定(误差≤1%)。两帧输入可恢复八帧90%的性能。失败分析表明:跨传感器预训练池化无效,视觉联合训练反而降低性能,输入归一化错误导致97%动态范围丢失却生成看似合理的中间结果。模型权重、代码及记忆层均已开源。

原文摘要 · Abstract (English)

Resistive pressure arrays are the cheapest and most widely shipped tactile sensors, yet tactile representation learning has concentrated on optical sensors that image a deforming gel. We present Tactus, an open model that answers text queries from pressure data alone: on the STAG benchmark (27 objects, held-out recordings), it reaches 0.771 +/- 0.062 top-1 over four runs (top-3 0.935), matching, and at best exceeding, the dataset's supervised closed-set CNN at 0.76, with no trained classifier head. The recipe is small-data: 187 training recordings, masked-autoencoder pretraining on 144k unlabeled same-sensor frames, and the sensor's own calibration affine, which recovered more accuracy than every architecture change combined. The released model's errors concentrate in a few contact-ambiguous classes, are uncorrelated with text-target geometry (Spearman rho <= 0.05 over 702 class pairs), and survive paraphrased and even bare-name queries within one point; two diverse frames recover 89% of eight-frame accuracy. Failures are reported with equal precision: cross-sensor pretraining pooling gave no gain, vision co-training degraded touch, and a mis-normalized input pipeline silently discarded 97% of the sensor's dynamic range while producing plausible intermediate results. Weights, code, and the memory layer the model plugs into are released openly.

触觉识别开放词汇压力传感小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。