arXiv:2608.05725cs.RO2026-08

将触觉几何重建推到传感器附近,实现低延迟、高能效的机器人快速反应。

Near-sensor Computing for Rapid Visuotactile Perception

论文配图:Near-sensor Computing for Rapid Visuotactile Perception
图 1 · 摘自论文原文
  • 设计流式硬件流水线,用光谱泊松求解器实时处理触觉数据。
  • 128x128画面首像素输入后0.211毫秒输出深度值,误差仅峰值深度的0.17%。
  • 适合对响应速度和能耗敏感的机器人触觉系统,如抓取防护回路。

视觉-触觉传感器从表面梯度测量中重建密集接触几何,但基于主机的处理会增加功耗,并引入数据传输延迟和可变调度延迟,限制了机器人的感知与响应速度。为解决这些问题,我们实现了一种近传感器计算框架,包含一个全流式硬件流水线的光谱泊松求解器。计算核心估计功耗为347 mW,无需依赖数据的分支或迭代收敛,实现确定性延迟。在166 MHz下运行时,每帧128x128数据在接收到首个像素后35,107个周期生成首个深度值,对应固定延迟0.211毫秒。在15种接触几何下,重构深度与双精度参考值偏差仅为峰值接触深度的0.17%。基于片上重构结果的决策可在28.3 ± 4.9毫秒内完成机器人保护反射回路,相较使用相同执行器的主机回路(169.9 ± 27.8毫秒)显著提升。结果表明,近传感器重建可在适合快速机器人接触响应的时间尺度上,提供准确、节能且确定性的触觉几何信息。

原文摘要 · Abstract (English)

Visuotactile sensors reconstruct dense contact geometry from measured surface gradients, but host-based processing increases power consumption and introduces data-transfer delays and variable scheduling latency, limiting the sensing and response speed of robotic systems. To address these limitations, we implement a near-sensor computing framework that includes a spectral Poisson solver as a fully streaming hardware pipeline. The computational core logic has an estimated power consumption of 347 mW and achieves high throughput without data-dependent branching or iterative convergence, thereby providing deterministic latency. Operating at 166 MHz, the pipeline produces the first depth value of each 128x128 frame 35,107 cycles after receiving the first input pixel, corresponding to a fixed latency of 0.211 ms. Across 15 contact geometries, the reconstructed depths differ from a double-precision reference by 0.17 % of the peak contact depth. On-chip decisions based on these reconstructions close a robot protective reflex loop in 28.3 +/- 4.9 ms, compared with 169.9 +/- 27.8 ms for an equivalent host-based loop using the same actuator. These results demonstrate that near-sensor reconstruction can provide accurate, energy-efficient, and deterministic tactile geometry on timescales suitable for rapid robotic contact responses.

触觉感知近传感器计算机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。