arXiv:2607.28416cs.RO2026-07被引 1

FasTac用多光谱视觉实现高速高精度3D形貌与力感知。

FasTac: A Curved Multispectral Vision-Based Tactile Sensor for High-Speed High-Precision 3D Shape and Force Perception

论文配图:FasTac: A Curved Multispectral Vision-Based Tactile Sensor for High-Speed High-Precision 3D Shape and Force Perception
图 1 · 摘自论文原文
  • 多光谱摄影测量+动态卷积,实现曲面触觉的精准建模。
  • 深度误差降至0.0415 mm,法向/切向力误差分别低至2.74%和2.39%。
  • 部署于FPGA,处理延迟仅1.09毫秒,适合实时机器人控制。

为实现灵巧操作所需的精细接触几何解析、法向与切向力区分及瞬态信号捕捉,现有曲面视觉触觉传感器难以在紧凑结构中兼顾高精度3D重建、三轴力估计与高速处理。本文提出FasTac,一种集成多光谱光度立体、动态卷积力估计与现场可编程门阵列(FPGA)硬件加速的曲面视觉触觉传感器。单图像传感器同步多光谱成像提供空间对齐观测,用于鲁棒表面法向估计;结合边界先验的快速泊松深度重建显著提升精度。HyperForce采用位置感知动态卷积,建模曲面弹性体的空间非均匀力学响应,实现三轴力估计。完整从图像到法向力的处理流程部署于FPGA。实验表明,近红外光照与边界先验将深度均方误差(MAE)从0.2730 mm降至0.0415 mm;HyperForce对法向与剪切力的归一化均方误差(NMAE)分别为2.74%和2.39%;FPGA部署使处理延迟从GPU的3.26 ms降至1.09 ms。多物体重建、反馈抓取与振动测量验证了其优异的几何感知、稳定力反馈与动态接触侦测能力。

原文摘要 · Abstract (English)

Curved tactile fingertips for dexterous manipulation must resolve fine contact geometry, distinguish normal and tangential loads, and capture transient signals. Existing curved vision-based tactile sensors struggle to combine accurate 3D reconstruction, three-axis force estimation, and high-speed processing in a compact form. This article presents FasTac, a curved vision-based tactile sensor integrating multispectral photometric stereo, dynamic-convolution force estimation, and hardware acceleration on a field-programmable gate array (FPGA). Single-image-sensor simultaneous multispectral imaging provides spatially aligned observations for robust surface normal estimation, followed by boundary-prior fast Poisson depth reconstruction. HyperForce uses position-aware dynamic convolution to model the spatially nonuniform mechanical response of curved elastomers and estimate three-axis forces. The complete image-to-normal-force pipeline is deployed on an FPGA. Experiments show that near-infrared (NIR) illumination and the boundary prior decrease depth mean absolute error (MAE) from 0.2730 mm to 0.0415 mm; HyperForce achieves normalized mean absolute error (NMAE) values of 2.74% and 2.39% for normal and shear forces, respectively; and FPGA deployment shortens processing latency from 3.26 ms on the GPU to 1.09 ms. Multi-object reconstruction, feedback grasping, and vibration measurement validate fine geometric perception, stable force feedback, and dynamic contact sensing.

触觉传感多光谱FPGA3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。