arXiv:2607.22332cs.CV2026-07

SLIP实现低延迟3D医学图像交互分割,支持快速响应与撤销操作。

SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images

论文配图:SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images
图 1 · 摘自论文原文
  • 分离图像编码与提示推理,复用特征提升效率
  • 13个公开数据集上性能领先,交互延迟显著降低
  • 实测用户偏好更高,适合临床标注场景

交互式深度图像分割通过用户点击等提示迭代优化分割结果,提升医学图像标注效率。现有基于块的方法如nnInteractive虽性能优异,但存在高交互延迟、对连续操作响应慢、不支持撤销提示等问题。评估多依赖模拟数据,缺乏真实用户验证。本文提出SLIP,一种端到端可训练的3D医学图像交互分割框架,将图像编码与提示引导的精修解耦:图像特征一次性计算并复用,轻量级块记忆库维护跨块的交互感知分割状态。该表示支持全局上下文传播,实现无需重算图像特征的可逆提示与低延迟更新。通过解耦设计,SLIP兼容多种图像编码器,单一模型即可泛化至多种解剖结构和成像模态。除标准模拟评估外,我们开展前瞻性受控用户研究,对比手动标注、nnInteractive与SLIP在三个临床任务中表现,六位专家参与,包含主观可用性评估,解决交互分割方法缺乏人类验证的问题。SLIP在13个公开数据集上达到最先进性能,同时具备更低延迟、更高响应性、支持可逆提示及更高用户偏好。

原文摘要 · Abstract (English)

Interactive deep image segmentation enables efficient medical image annotation by iteratively refining predictions from user prompts, such as positive and negative clicks. Recent patch-based methods, including nnInteractive, achieve strong segmentation performance but remain limited in annotation workflows by high interaction latency, limited responsiveness to successive interactions, and the lack of support for reversible prompting. Furthermore, evaluation relies predominantly on simulated rather than controlled real-user interaction studies. We present SLIP, an end-to-end trainable framework for interactive 3D medical image segmentation that decouples image encoding from prompt-guided refinement. Image features are computed once and reused, while a lightweight patch memory bank maintains an interaction-aware segmentation state shared across patches. This representation enables prediction updates by propagating interaction context throughout the image, supports reversible prompting without recomputing image features, and substantially reduces interaction latency. By separating image representation from interactive reasoning, SLIP remains compatible with a wide range of image encoders. We train a single SLIP model for general interactive segmentation across diverse anatomical structures and imaging modalities. Beyond standard simulated evaluation, we conduct a controlled prospective user study comparing manual segmentation, nnInteractive, and SLIP across three clinical annotation tasks, six expert participants, and subjective usability measures, addressing the limited human validation of interactive segmentation methods. SLIP achieves SOTA interactive segmentation performance across 13 public datasets while providing lower interaction latency, greater responsiveness, support for reversible prompting, and higher user preference than existing approaches.

医学图像交互分割3D分割低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。