arXiv:2512.21984cs.CV2025-12被引 1

轻量级多尺度注意力框架,实现实时脊柱内窥镜实例分割

A Lightweight Multi-Scale Attention Framework for Real-Time Spinal Endoscopic Instance Segmentation

  • 设计跨主干、颈部、头部的轻量多尺度注意力架构
  • 参数仅180万,推理速度达实时,精度优于多数方法
  • 适用于手术设备有限的临床场景,支持单批次训练

脊柱内窥镜实时实例分割对术中关键解剖结构识别与保护至关重要,但受限于视野狭窄、反光、烟雾/出血、边界模糊及尺度剧烈变化。同时,手术硬件资源有限,模型需兼顾精度与速度,并在小批量(甚至单样本)训练下保持稳定。本文提出LMSF-A,一种在主干、颈部和头部协同设计的轻量多尺度注意力框架。主干采用C2f-Pro模块,融合RepViT风格重参数卷积(RVB)与高效多尺度注意力(EMA),支持多分支训练并推理时合并为单一快速路径。颈部通过尺度序列特征融合(SSFF)和三重特征编码(TFE)增强跨尺度一致性与边界细节,强化高分辨率特征。头部采用轻量多任务共享头(LMSH),使用共享卷积与组归一化,减少参数量并提升单批次训练稳定性。我们还发布了经临床评审的PELD数据集(61例患者,610张图像),包含脂肪组织、骨、黄韧带和神经的实例掩码。实验表明,LMSF-A在各项评估指标上具有竞争力(甚至更优),参数仅1.8M,计算量8.8 GFLOPs,且在公开牙齿基准上具有良好泛化能力。代码与数据集:https://github.com/hhwmortal/PELD-Instance-segmentation。

原文摘要 · Abstract (English)

Real-time instance segmentation for spinal endoscopy is important for identifying and protecting critical anatomy during surgery, but it is difficult because of the narrow field of view, specular highlights, smoke/bleeding, unclear boundaries, and large scale changes. Deployment is also constrained by limited surgical hardware, so the model must balance accuracy and speed and remain stable under small-batch (even batch-1) training. We propose LMSF-A, a lightweight multi-scale attention framework co-designed across backbone, neck, and head. The backbone uses a C2f-Pro module that combines RepViT-style re-parameterized convolution (RVB) with efficient multi-scale attention (EMA), enabling multi-branch training while collapsing into a single fast path for inference. The neck improves cross-scale consistency and boundary detail using Scale-Sequence Feature Fusion (SSFF) and Triple Feature Encoding (TFE), which strengthens high-resolution features. The head adopts a Lightweight Multi-task Shared Head (LMSH) with shared convolutions and GroupNorm to reduce parameters and support batch-1 stability. We also release the clinically reviewed PELD dataset (61 patients, 610 images) with instance masks for adipose tissue, bone, ligamentum flavum, and nerve. Experiments show that LMSF-A is highly competitive (or even better than) in all evaluation metrics and much lighter than most instance segmentation methods requiring only 1.8M parameters and 8.8 GFLOPs, and it generalizes well to a public teeth benchmark. Code and dataset: https://github.com/hhwmortal/PELD-Instance-segmentation.

实例分割轻量模型医疗影像实时处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。