arXiv:2501.18855cs.CV2025-01被引 2

用轻量SAM提取通用特征,提升裂缝分割的适应性与效率

FlexiCrackNet: A Flexible Pipeline for Enhanced Crack Segmentation with General Features Transfered from SAM

  • 用EdgeSAM轻量编码器提取通用特征,解耦输入尺寸限制
  • 引入交互门控注意力机制,融合多层特征提升分割精度
  • 适合资源受限环境,零样本泛化能力强,实用于智能巡检

自动裂缝分割是道路安全维护和结构完整性系统中智能视觉感知的核心技术。现有深度学习模型及“预训练+微调”范式在资源受限环境下适应性差,跨数据域扩展能力不足。为此,我们提出FlexiCrackNet,一种将传统深度学习与大规模预训练模型优势融合的新管道。其核心采用编码器-解码器架构,以轻量级EdgeSAM的CNN编码器作为通用特征提取器,摆脱了EdgeSAM固定输入尺寸的限制。为协调通用特征与领域特定特征,提出信息-交互门控注意力机制(IGAM),自适应融合多层级特征,增强分割性能并抑制无关噪声。该设计实现通用知识高效迁移,同时支持多样输入分辨率与资源受限环境。实验表明,FlexiCrackNet优于当前最优方法,在零样本泛化、计算效率及复杂场景(如模糊输入、复杂背景、视觉模糊伪影)下的鲁棒性方面表现优异。这些进展凸显了FlexiCrackNet在自动化裂缝检测与全面结构健康监测系统中的实际应用潜力。

原文摘要 · Abstract (English)

Automatic crack segmentation is a cornerstone technology for intelligent visual perception modules in road safety maintenance and structural integrity systems. Existing deep learning models and ``pre-training + fine-tuning'' paradigms often face challenges of limited adaptability in resource-constrained environments and inadequate scalability across diverse data domains. To overcome these limitations, we propose FlexiCrackNet, a novel pipeline that seamlessly integrates traditional deep learning paradigms with the strengths of large-scale pre-trained models. At its core, FlexiCrackNet employs an encoder-decoder architecture to extract task-specific features. The lightweight EdgeSAM's CNN-based encoder is exclusively used as a generic feature extractor, decoupled from the fixed input size requirements of EdgeSAM. To harmonize general and domain-specific features, we introduce the information-Interaction gated attention mechanism (IGAM), which adaptively fuses multi-level features to enhance segmentation performance while mitigating irrelevant noise. This design enables the efficient transfer of general knowledge to crack segmentation tasks while ensuring adaptability to diverse input resolutions and resource-constrained environments. Experiments show that FlexiCrackNet outperforms state-of-the-art methods, excels in zero-shot generalization, computational efficiency, and segmentation robustness under challenging scenarios such as blurry inputs, complex backgrounds, and visually ambiguous artifacts. These advancements underscore the potential of FlexiCrackNet for real-world applications in automated crack detection and comprehensive structural health monitoring systems.

裂缝分割轻量化模型特征迁移结构健康监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。