不训练模型,直接解码内部语义响应,提升跨域裂缝分割精度。
Training-Free Decoding of SAM3 Semantic Responses for Cross-Domain Infrastructure Crack Segmentation

- 通过直接解码冻结模型的内部语义响应,替代原有提议输出
- 在5个未见数据集上达到58.00%平均裂缝交并比,优于原版SAM3
- 无需微调,适合无标注数据的工程裂缝检测场景
跨域基础设施裂缝分割受材料差异、成像条件、裂缝形态及背景干扰影响。尽管文本提示基础模型减少了对特定任务训练的需求,但SAM3的原始提议接口未能充分暴露模型内部已编码的裂缝证据。本文发现并量化了输出接口不匹配问题:内部语言条件响应中保留了与真实标签对齐的裂缝特征,而原生提议输出中缺失该信息。基于此,提出训练免更新的语义-边缘响应解码(SERD)方法,将基于提议的读出替换为直接响应解码。SERD对密集响应进行归一化,使用固定Sobel先验校准,并应用单一阈值生成裂缝掩码。整个过程保持SAM3冻结,无需目标域标注。仅用一个源域数据集选择阈值,SERD在五个未见数据集上实现平均裂缝交并比58.00%,高于原版SAM3的54.33%。在六种旋转源域设置下,平均目标域交并比达60.23%,边界F1为67.18%,分别优于SAM3 3.27和2.70个百分点。结果表明,任务对齐的内部响应解码提供了一种简单且可迁移的跨域裂缝分割方案。
原文摘要 · Abstract (English)
Cross-domain infrastructure crack segmentation is challenged by variations in materials, imaging conditions, crack morphology, and background interference. Although text-promptable foundation models reduce the need for task-specific training, SAM3's native proposal interface may not fully expose the crack evidence already encoded by the frozen model. We identify and quantify an output-interface mismatch in which the internal language-conditioned response preserves ground-truth-aligned crack evidence that is absent from the native proposal output. Based on this finding, we propose \textbf{S}emantic-\textbf{E}dge \textbf{R}esponse \textbf{D}ecoding (\textbf{SERD}), a training-free method that replaces proposal-based readout with direct response decoding. SERD normalizes the dense response, calibrates it using a fixed Sobel prior, and applies a single threshold to produce the crack mask. SAM3 remains frozen without any target-domain annotations. Using one source domain solely for threshold selection, SERD achieves an average Crack IoU of 58.00\% on five unseen datasets, compared with 54.33\% for native SAM3. Across six rotated source-domain settings, it obtains a mean target-domain IoU of 60.23\% and a Boundary F1 of 67.18\%, exceeding SAM3 by 3.27 and 2.70 percentage points, respectively. The results show that task-aligned internal-response decoding provides a simple and transferable solution for cross-domain infrastructure crack segmentation. \textit{Code is available at: \href{https://github.com/xauat-liushipeng/SERD}{GitHub}.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。