arXiv:2510.04074cs.RO2025-10被引 1

通过视觉与拓扑反馈提升手术机器人自主解剖能力

Feedback Matters: Augmenting Autonomous Dissection with Visual and Topological Feedback

  • 基于内窥镜图像实时分析组织拓扑变化,生成结构化反馈
  • 引入可视性度量优化组织暴露,降低误判率
  • 兼容规划与学习方法,显著提升复杂场景下的鲁棒性

自主外科系统需应对组织特性与视觉线索快速变化的动态环境。反馈能力——感知、解析并响应执行过程中的变化——是实现适应性的核心。尽管已有研究探索了工具与组织追踪、错误检测等反馈机制,现有方法仍难以应对解剖过程中复杂的拓扑与感知挑战。本文提出一种支持反馈的自主组织解剖框架,能从每次解剖动作后的内窥镜图像中显式推理拓扑变化,生成结构化反馈以指导后续操作,实现解剖进展定位与策略在线调整。为提升反馈可靠性,我们设计了量化组织暴露程度的可视性度量,并构建主动操控组织以最大化可视性的最优控制器。最终,该反馈机制被集成至基于规划与基于学习的解剖方法中,实验表明其显著提升了自主性、降低了错误率,并增强了复杂手术场景下的鲁棒性。

原文摘要 · Abstract (English)

Autonomous surgical systems must adapt to highly dynamic environments where tissue properties and visual cues evolve rapidly. Central to such adaptability is feedback: the ability to sense, interpret, and respond to changes during execution. While feedback mechanisms have been explored in surgical robotics, ranging from tool and tissue tracking to error detection, existing methods remain limited in handling the topological and perceptual challenges of tissue dissection. In this work, we propose a feedback-enabled framework for autonomous tissue dissection that explicitly reasons about topological changes from endoscopic images after each dissection action. This structured feedback guides subsequent actions, enabling the system to localize dissection progress and adapt policies online. To improve the reliability of such feedback, we introduce visibility metrics that quantify tissue exposure and formulate optimal controller designs that actively manipulate tissue to maximize visibility. Finally, we integrate these feedback mechanisms with both planning-based and learning-based dissection methods, and demonstrate experimentally that they significantly enhance autonomy, reduce errors, and improve robustness in complex surgical scenarios.

手术机器人自主解剖反馈机制视觉反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。