用触觉信号实时识别颗粒物类型，实现物理颗粒与虚拟内容的交互。
DipMe: Haptic Recognition of Granular Media for Tangible Interactive Applications
- 通过设备浸入动作采集触觉信号进行颗粒物识别。
- 机器学习可区分不同颗粒物的触觉特征，识别准确率高。
- 适用于需要触觉感知的物理-虚拟交互应用开发。
尽管实体用户界面在与刚性或柔软物体交互中表现出优势，但用户难以方便地使用不同类型的颗粒材料作为交互媒介。本文提出DipMe，一种智能设备，能够实时识别颗粒材料类型，从而将物理世界的颗粒材料与各类虚拟内容相连接。不同于基于视觉的方案，我们设计了设备的浸入操作，并利用触觉信号来识别不同颗粒材料。借助现代机器学习工具，我们发现不同颗粒材料产生的触觉信号具有可区分性。通过在线颗粒物识别，我们构建了多个实体交互应用，展示了DipMe在感知颗粒材料方面的效果及其在以颗粒物为新媒介的实体用户界面中的潜力。
原文摘要 · Abstract (English)
While tangible user interface has shown its power in naturally interacting with rigid or soft objects, users cannot conveniently use different types of granular materials as the interaction media. We introduce DipMe as a smart device to recognize the types of granular media in real time, which can be used to connect the granular materials in the physical world with various virtual content. Other than vision-based solutions, we propose a dip operation of our device and exploit the haptic signals to recognize different types of granular materials. With modern machine learning tools, we find the haptic signals from different granular media are distinguishable by DipMe. With the online granular object recognition, we build several tangible interactive applications, demonstrating the effects of DipMe in perceiving granular materials and its potential in developing a tangible user interface with granular objects as the new media.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。