构建首个主动触觉感知基准,助力机器人更聪明地感知物体。
Tactile MNIST: Benchmarking Active Tactile Perception
- 设计可复现的触觉感知任务环境,支持主动探索与多模态融合。
- 包含13,500个3D数字模型和153,600组真实触觉数据,覆盖复杂场景。
- 开源兼容Gymnasium,适合触觉传感与智能控制研究者使用。
触觉感知可通过提供丰富的局部信息,显著提升机器人灵巧操作能力,弥补视觉等模态的不足。然而,由于触觉本身具有局部性,难以独立完成需要全局空间理解的任务。受人类感知启发,采用主动感知策略——主动引导传感器探测高信息量区域,并随时间整合信息以理解场景或完成任务,是有效解决方案。尽管主动感知与触觉传感方法近年备受关注,但两领域仍缺乏统一评估标准。为此,本文提出Tactile MNIST基准套件,一个开源、兼容Gymnasium的主动触觉感知评测平台,涵盖定位、分类与体积估计等任务。该套件包含从简单仿真到基于视觉触觉传感器的复杂任务的多样化场景。同时,我们构建了包含13,500个合成3D MNIST数字模型和153,600组真实触觉样本的数据集,用于训练CycleGAN实现逼真触觉模拟。通过标准化协议与可复现评估框架,本工作推动触觉传感与主动感知领域的系统性进步。
原文摘要 · Abstract (English)
Tactile perception has the potential to significantly enhance dexterous robotic manipulation by providing rich local information that can complement or substitute for other sensory modalities such as vision. However, because tactile sensing is inherently local, it is not well-suited for tasks that require broad spatial awareness or global scene understanding on its own. A human-inspired strategy to address this issue is to consider active perception techniques instead. That is, to actively guide sensors toward regions with more informative or significant features and integrate such information over time in order to understand a scene or complete a task. Both active perception and different methods for tactile sensing have received significant attention recently. Yet, despite advancements, both fields lack standardized benchmarks. To bridge this gap, we introduce the Tactile MNIST Benchmark Suite, an open-source, Gymnasium-compatible benchmark specifically designed for active tactile perception tasks, including localization, classification, and volume estimation. Our benchmark suite offers diverse simulation scenarios, from simple toy environments all the way to complex tactile perception tasks using vision-based tactile sensors. Furthermore, we also offer a comprehensive dataset comprising 13,500 synthetic 3D MNIST digit models and 153,600 real-world tactile samples collected from 600 3D printed digits. Using this dataset, we train a CycleGAN for realistic tactile simulation rendering. By providing standardized protocols and reproducible evaluation frameworks, our benchmark suite facilitates systematic progress in the fields of tactile sensing and active perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。