arXiv:2412.20758cs.ROcs.HC2024-12被引 1

用微结构增强视觉触觉传感,实现高精度低功耗检测

High-Performance Vision-Based Tactile Sensing Enhanced by Microstructures and Lightweight CNN

  • 通过微槽结构调制光传输,放大形变视觉信号
  • 仅用单层卷积网络,误差低于0.05mm,力检测精度达5mN
  • 适合软体机器人集成,抗电干扰,适合人机交互场景

触觉感知在高级交互系统中至关重要,通过模拟人类触觉来检测外界刺激。基于视觉的触觉传感器具有多模态能力和高鲁棒性,但现有技术在灵敏度、空间分辨率和深度学习图像处理的高计算需求方面仍存在局限。本文提出一种结合新型微结构传感器设计与高效图像处理的综合方法,证明精心设计的微结构可显著提升性能并降低计算负载。传感器表面采用微加工沟槽,无需传统追踪标记,通过调节光传输放大外力响应。通过超轻量卷积神经网络提取增强后的图像特征,可高精度推断接触位置、位移和施加力。理论分析表明,微沟槽显著放大了形变的视觉效应。仅使用商用网络摄像头,该系统成功检测低于5 mN的力,实现毫米级单点空间分辨率。使用仅含一个卷积层的模型,平均绝对误差低于0.05 mm。其柔软传感器本体便于与软体机器人无缝集成,且对电串扰和干扰具有免疫力,确保在复杂人机环境中可靠运行。

原文摘要 · Abstract (English)

Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors are promising for providing multimodal capabilities and high robustness, yet existing technologies still have limitations in sensitivity, spatial resolution, and high computational demands of deep learning-based image processing. This paper presents a comprehensive approach combining a novel microstructure-based sensor design and efficient image processing, demonstrating that carefully engineered microstructures can significantly enhance performance while reducing computational load. Without traditional tracking markers, our sensor incorporates an surface with micromachined trenches, as an example of microstructures, which modulate light transmission and amplify the response to applied force. The amplified image features can be extracted by a ultra lightweight convolutional neural network to accurately inferring contact location, displacement, and applied force with high precision. Through theoretical analysis, we demonstrated that the micro trenches significantly amplified the visual effects of shape distortion. Using only a commercial webcam, the sensor system effectively detected forces below 5 mN, and achieved a millimetre-level single-point spatial resolution. Using a model with only one convolutional layer, a mean absolute error below 0.05 mm was achieved. Its soft sensor body allows seamless integration with soft robots, while its immunity to electrical crosstalk and interference guarantees reliability in complex human-machine environments.

触觉传感微结构轻量化模型软体机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。