机器人自主扫描腹部,融合视觉与触觉反馈,实现高精度三维成像。
Visuotactile and Explicitly Force-Controlled Robotic Ultrasound for Abdominal Volumetric Reconstruction
- 融合立体视觉、触觉反馈和专家扫描策略,实现自适应扫描
- 可生成患者特异性三维解剖图,准确识别肋骨边界
- 适合临床超声自动化,提升诊断与体积分析能力
本文提出一种集成立体视觉、触觉反馈与专家经验策略的机器人超声采集系统,实现腹部自主适应性扫描。系统通过记录专家放射科医师的手动运动与施力数据,构建可复现典型扫描路径的框架。利用立体视觉生成患者腹部三维地形图,并在关键点进行刚度测量以精确定位肋骨边界。结合上述信息,机器人执行两种扫描路径:沿肋骨下方呈上倾角扫查以观察上腹部结构,以及垂直扫查软组织区域。采用具备扭矩控制的七自由度柔顺机械臂,在不同解剖表面维持稳定的探头接触。物理实验表明,该系统成像质量可媲美专家操作,且能动态适应个体化腹部形态。此外,机器人突破专家局限,实现三维体积数据获取,显著增强诊断潜力并支持高级分析。本工作展示了将专家知识融入自主机器人系统的可行性,凸显了感知驱动自主与物理推理结合在提升诊断性能方面的价值。
原文摘要 · Abstract (English)
In this paper, we present a robotic ultrasound acquisition system that integrates stereo vision, touch-based feedback, and expert-informed strategies to perform autonomous and adaptive abdominal scans. The system records freehand motion and force data from expert radiologists, creating a framework to capture transducer motion, applied forces, and anatomical scanning strategies. This expert data is replayed to replicate characteristic scans with the robot, forming a foundation for further autonomous capabilities. Using stereo vision, the system generates three-dimensional topography maps of the patient's abdomen, which are refined through stiffness measurements at key points to delineate the rib cage boundary. These combined techniques enable the robot to execute two distinct scanning paths: an upward-angled sweep beneath the rib cage to visualize structures near the upper abdomen and a perpendicular sweep across soft tissue regions. A compliant, torque-controlled seven degree-of-freedom robotic manipulator is controlled to maintain consistent probe contact through closed-loop force control over the varied anatomical surfaces. Physical experiments demonstrate that the system achieves high-quality imaging comparable to expert scans while dynamically adapting to patient-specific topographies. Furthermore, the robotic system surpasses expert capabilities by enabling three-dimensional volume acquisition, which enhances diagnostic potential and provides volumetric data for advanced analyses. This work highlights the integration of expert knowledge into autonomous robotic systems and underscores the potential of combining perception-based autonomy with physical reasoning for enhanced diagnostic performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。