用轻量适配器让SAM模型更好分割工业X光缺陷,效果显著提升。
XCT-SAM: Sequential Parameter-Efficient Domain Adaptation of SAM for Industrial XCT Defect Segmentation

- 分步用微结构数据和真实XCT数据逐步适配SAM,缩小领域差距。
- 仅训练415万参数,保持99%模型冻结,仍实现最佳分割精度。
- 适合工业无损检测场景,尤其适用于标注数据稀缺的缺陷识别。
增材制造(AM)X射线计算机断层扫描(XCT)图像中的缺陷分割因类别严重失衡及不同扫描条件下分布差异大而面临挑战。尽管近期基础模型如分割一切模型(SAM)具备强大的通用分割先验,但其自然图像预训练难以迁移到AM XCT领域,因缺陷表现为细微的非语义微结构异常。此外,由于领域差距大且真实XCT标注数据稀缺,直接适配SAM受限。本文提出XCT-SAM,一种用于工业XCT缺陷分割的顺序参数高效适应框架。不同于直接从自然图像适配到XCT数据,我们首先在合金微结构数据集上微调卷积型LoRA适配器,再将已适配模型迁移至XCT图像,逐步弥合领域差距。采用秩r=2的Conv-LoRA适配器,在引入卷积空间归纳偏置的同时,仅训练约415万参数,保持超过99%模型冻结。在分布外的CycleGAN-XCT基准和真实NIST XCT扫描数据上评估,XCT-SAM始终优于零样本SAM及其他领域适配基线,获得最优整体交并比(IoU)与Dice分数。结果证明,通过参数高效适配器进行中间领域适配对工业XCT缺陷分割有效。源代码公开于https://github.com/Mahedi-61/XCT-SAM.git。
原文摘要 · Abstract (English)
Defect segmentation in additive manufacturing (AM) X-ray computed tomography (XCT) images remains challenging due to severe class imbalance and large distribution shifts across scan conditions. Although recent foundation models such as the Segment Anything Model (SAM) provide strong general-purpose segmentation priors, their natural-image pre-training transfers poorly to the AM XCT domain, where defects appear as subtle non-semantic microstructural anomalies. Moreover, adapting SAM to the AM domain is further limited by the large domain gap and scarcity of labeled real XCT data. We present XCT-SAM, a sequential parameter-efficient adaptation framework for AM XCT defect segmentation. Instead of adapting SAM directly from natural images to XCT data, we first fine-tune Conv-LoRA adapters on an alloy-microstructure dataset and subsequently transfer the adapted model to XCT images, progressively bridging the domain gap. Using Conv-LoRA adapters with rank r=2, the framework injects convolutional spatial inductive bias into SAM's backbone while training approximately 4.15M parameters and keeping over 99% of the model frozen. We evaluate XCT-SAM on out-of-distribution CycleGAN-XCT benchmarks and real-world NIST XCT scans. Across both settings, XCT-SAM consistently outperforms zero-shot SAM and other domain-adapted SAM baselines, achieving the best overall IoU and Dice scores. These results demonstrate the effectiveness of intermediate domain adaptation with parameter-efficient adapters for industrial XCT defect segmentation. The source code is publicly available at https://github.com/Mahedi-61/XCT-SAM.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。