arXiv:2504.04034cs.CV2025-04被引 2

提出通用曲线结构分割模型UCS,提升跨领域泛化能力。

UCS: A Universal Model for Curvilinear Structure Segmentation

  • 用稀疏适配器和傅里叶提示生成,增强SAM对曲线结构的适应性。
  • 在医疗、工程、自然、植物图像上均达到领先性能,支持开集分割。
  • 无需人工交互,通过双压缩模块保留细节,适合多场景应用。

曲线结构分割(CSS)在医学影像、地形分析、工业表面检测和植物分析等领域至关重要。现有方法虽在特定领域表现优异,但泛化能力有限;而大规模模型如SAM虽具强泛化性,却未针对曲线结构优化。现有对SAM的改进多聚焦通用目标分割,缺乏针对CSS的专门设计。为此,我们提出通用曲线结构分割(UCS)模型,将SAM适配至CSS任务并进一步提升跨域泛化能力。UCS采用新编码器架构,融合预训练SAM编码器,并引入两个创新:稀疏适配器,可继承SAM泛化能力且减少微调参数;提示生成模块,利用快速傅里叶变换与高通滤波生成曲线特异性提示。此外,UCS包含掩码解码器,通过双压缩模块消除对手动交互的依赖:层级特征压缩模块聚合采样编码器输出以增强细节保留,引导特征压缩模块提取并压缩图像驱动的引导特征。在涵盖八类自然曲线结构的自建多领域数据集上评估,UCS在医疗、工程、自然及植物图像中均展现出最先进的泛化与开集分割性能,确立了通用CSS的新基准。代码已开源:https://github.com/kylechuuuuu/UCS。

原文摘要 · Abstract (English)

Curvilinear structure segmentation (CSS) is essential in various domains, including medical imaging, landscape analysis, industrial surface inspection, and plant analysis. While existing methods achieve high performance within specific domains, their generalizability is limited. On the other hand, large-scale models such as Segment Anything Model (SAM) exhibit strong generalization but are not optimized for curvilinear structures. Existing adaptations of SAM primarily focus on general object segmentation and lack specialized design for CSS tasks. To bridge this gap, we propose the Universal Curvilinear structure Segmentation (UCS) model, which adapts SAM to CSS tasks while further enhancing its cross-domain generalization. UCS features a novel encoder architecture integrating a pretrained SAM encoder with two innovations: a Sparse Adapter, strategically inserted to inherit the pre-trained SAM encoder's generalization capability while minimizing the number of fine-tuning parameters, and a Prompt Generation module, which leverages Fast Fourier Transform with a high-pass filter to generate curve-specific prompts. Furthermore, the UCS incorporates a mask decoder that eliminates reliance on manual interaction through a dual-compression module: a Hierarchical Feature Compression module, which aggregates the outputs of the sampled encoder to enhance detail preservation, and a Guidance Feature Compression module, which extracts and compresses image-driven guidance features. Evaluated on a comprehensive multi-domain dataset, including an in-house dataset covering eight natural curvilinear structures, UCS demonstrates state-of-the-art generalization and open-set segmentation performance across medical, engineering, natural, and plant imagery, establishing a new benchmark for universal CSS. The source code is available at https://github.com/kylechuuuuu/UCS.

曲线分割通用模型图像分割SAM改进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。