用预训练知识增强YOLO,提升多平面MRI脑瘤检测精度
PK-YOLO: Pretrained Knowledge Guided YOLO for Brain Tumor Detection in Multiplanar MRI Slices
- 用稀疏掩码建模训练轻量骨干网络,提取可迁移特征
- 在多平面MRI上实现优于主流YOLO与DETR模型的检测性能
- 特别擅长小尺寸脑瘤检测,适合医学影像分析研究者
多平面磁共振成像(MRI)中脑肿瘤检测因图像结构多样性和形态差异而极具挑战。本文提出一种基于预训练知识(PK)引导的新型YOLO检测模型——PK-YOLO,是首个面向该任务的预训练知识驱动的YOLO检测器。方法包括:通过稀疏掩码建模训练的轻量级卷积神经网络骨干;结合预训练骨干的YOLO架构;以及针对小目标检测优化的回归损失函数。预训练骨干使单平面MRI切片中的对象查询特征可有效迁移到模型编码器中,所学领域知识库提升了域内检测能力。改进的损失函数进一步增强对多平面二维MRI中微小脑瘤的检测表现。实验表明,PK-YOLO在多平面MRI脑肿瘤检测数据集上性能优于当前先进YOLO类与DETR类检测器。代码已开源:https://github.com/mkang315/PK-YOLO。
原文摘要 · Abstract (English)
Brain tumor detection in multiplane Magnetic Resonance Imaging (MRI) slices is a challenging task due to the various appearances and relationships in the structure of the multiplane images. In this paper, we propose a new You Only Look Once (YOLO)-based detection model that incorporates Pretrained Knowledge (PK), called PK-YOLO, to improve the performance for brain tumor detection in multiplane MRI slices. To our best knowledge, PK-YOLO is the first pretrained knowledge guided YOLO-based object detector. The main components of the new method are a pretrained pure lightweight convolutional neural network-based backbone via sparse masked modeling, a YOLO architecture with the pretrained backbone, and a regression loss function for improving small object detection. The pretrained backbone allows for feature transferability of object queries on individual plane MRI slices into the model encoders, and the learned domain knowledge base can improve in-domain detection. The improved loss function can further boost detection performance on small-size brain tumors in multiplanar two-dimensional MRI slices. Experimental results show that the proposed PK-YOLO achieves competitive performance on the multiplanar MRI brain tumor detection datasets compared to state-of-the-art YOLO-like and DETR-like object detectors. The code is available at https://github.com/mkang315/PK-YOLO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。