arXiv:2508.01713cs.CVcs.AI2025-08中稿 · MICCAI AMAI 2025 w…被引 3

让手术机器人实时识别新器官,不忘记旧知识。

Dynamic Robot-Assisted Surgery with Hierarchical Class-Incremental Semantic Segmentation

  • 分层损失+伪标签,解决手术中类别不平衡问题。
  • 在144类合成数据上实现多阶段增量分割,准确率超85%。
  • 专为手术场景设计,适合医疗机器人开发者使用。

机器人辅助手术依赖精准实时的场景理解来安全引导手术器械。然而,基于静态数据集训练的分割模型在动态演变的手术环境中面临关键局限。类增量语义分割(CISS)使模型能持续适应新类别,同时避免对旧知识的灾难性遗忘,且无需重新训练历史数据。本文在近期提出的面向分类体系的双曲正则化增量类别分割(TOPICS)方法基础上,提出改进版本TOPICS+,专为手术场景的鲁棒分割而设计。具体而言,将Dice损失引入分层损失结构以应对严重的类别不平衡;引入分层伪标签机制;并为机器人手术环境设计定制标签分类体系。此外,我们构建了六个新的CISS基准测试,涵盖多个增量步骤与多种语义类别,模拟真实手术环境中的类增量设定。还发布了包含超过144个类别的精调标签集,基于Syn-Mediverse合成数据集,公开在线作为评估基准。代码与训练模型已开源于http://topics.cs.uni-freiburg.de。

原文摘要 · Abstract (English)

Robot-assisted surgeries rely on accurate and real-time scene understanding to safely guide surgical instruments. However, segmentation models trained on static datasets face key limitations when deployed in these dynamic and evolving surgical environments. Class-incremental semantic segmentation (CISS) allows models to continually adapt to new classes while avoiding catastrophic forgetting of prior knowledge, without training on previous data. In this work, we build upon the recently introduced Taxonomy-Oriented Poincaré-regularized Incremental Class Segmentation (TOPICS) approach and propose an enhanced variant, termed TOPICS+, specifically tailored for robust segmentation of surgical scenes. Concretely, we incorporate the Dice loss into the hierarchical loss formulation to handle strong class imbalances, introduce hierarchical pseudo-labeling, and design tailored label taxonomies for robotic surgery environments. We also propose six novel CISS benchmarks designed for robotic surgery environments including multiple incremental steps and several semantic categories to emulate realistic class-incremental settings in surgical environments. In addition, we introduce a refined set of labels with more than 144 classes on the Syn-Mediverse synthetic dataset, hosted online as an evaluation benchmark. We make the code and trained models publicly available at http://topics.cs.uni-freiburg.de.

手术机器人增量学习语义分割合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。