用校准的数字孪生生成触觉数据,提升浅层血管定位可靠性。
Toward Trustworthy Robot-Assisted Sliding Palpation for Shallow Vessel Localisation with a Calibrated Digital Twin

- 通过校准数字孪生模拟真实触觉序列,减少对物理实验依赖。
- 在四种跨域测试中平均定位误差1.05至5.49毫米,最深接触误差仅0.50毫米。
- 结果可解释、可验证,适合医疗机器人与触觉仿真研究者。
可靠定位浅层皮下血管对安全的机器人辅助静脉穿刺和血管感知操作至关重要,但收集多样化的触觉数据成本高、耗时长,且易损坏基于视觉的软性触觉传感器。本文提出一种机器人辅助滑动触诊框架,利用校准后的数字孪生生成带标签的触觉序列,降低对真实数据的依赖。该孪生模型模拟传感器-血管接触,通过基于贝叶斯优化的领域自适应方法与真实触诊轨迹校准,并在滑动方向和接触条件上进行随机化。采用时空图神经网络,基于模拟标记轨迹进行节点级血管分类,并通过2D-to-3D-to-2D几何投影生成人类可验证的俯视定位图。我们在三个数据集(Sim、Silicone、Meat)上评估,其中Meat为含0至30毫米深度血管模型的生肉仿体。采用四种训练-测试配置:Sim→Sim、Sim→Silicone、Sim→Meat、Meat→Silicone。校准后孪生模型在四类典型交互中实现最深接触下0.50毫米的模拟-真实标记对齐均方误差。经重投影至1毫米分辨率俯视网格后,预测血管像素与真实血管像素平均距离为1.05至5.49毫米,除Sim→Meat外其余均低于1.31毫米。后者误差较大反映了更显著的域偏移及当前仿真迁移的局限。结果表明,通过校准仿真、可解释定位与透明跨域评估,向可信触觉触诊迈出重要一步。代码、模型权重与数据已公开于GitHub与Zenodo。
原文摘要 · Abstract (English)
Reliable localisation of shallow subsurface vessels is important for safe robot-assisted venous access and vessel-aware manipulation, but collecting diverse tactile data on physical hardware is costly, time-consuming, and can degrade soft vision-based tactile sensors. We present a robot-assisted sliding-palpation framework in which a calibrated digital twin generates labelled tactile sequences, reducing reliance on real-world data. The twin models sensor-vessel contact, is calibrated against real palpation trajectories using Bayesian-optimisation-based domain adaptation, and is randomised over sliding direction and contact conditions. A spatio-temporal graph neural network trained on simulated marker trajectories performs per-node vessel classification and produces a human-verifiable top-view localisation map through 2D-to-3D-to-2D geometric projection. We evaluate three datasets: Sim, Silicone, and Meat, the latter a raw-meat phantom with vessel models at nominal depths of 0 to 30 mm, using four train-to-test configurations: Sim to Sim, Sim to Silicone, Sim to Meat, and Meat to Silicone. The calibrated twin achieves a simulated-to-real marker-alignment mean absolute error of 0.50 mm at deepest contact across four canonical interactions. After reprojection onto a 1 mm top-view grid, predicted vessel pixels lie on average 1.05 to 5.49 mm from the nearest true vessel pixel across the four models, with 1.05 to 1.31 mm for all except Sim to Meat. The larger error for Sim to Meat reflects the greater domain shift and current limit of simulation transfer. These results demonstrate progress toward trustworthy tactile palpation through calibrated simulation, interpretable localisation, and transparent cross-domain evaluation. Code, model weights, and data are publicly available on GitHub and Zenodo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。