用高光谱成像实现肝脏转移癌术中像素级分类,仅用1%标注数据即达93%准确率
A Hyperspectral Imaging Dataset and Methodology for Intraoperative Pixel-Wise Classification of Metastatic Colon Cancer in the Liver
- 结合半监督学习与多尺度特征提取,用极少标注数据训练模型
- 在1%标注数据下达到0.9313的平衡准确率,显著优于传统RGB图像
- 适合病理影像、医学图像分析研究者,尤其关注低样本学习场景
高光谱成像(HSI)在计算病理学中具有巨大潜力,但目前缺乏用于训练深度学习模型的像素级标注数据。为解决此问题,本文构建了27个来自14名结肠腺癌肝转移患者的冰冻切片高光谱图像数据库,波段范围450–800 nm,分辨率1 nm,图像尺寸1384×1035像素,由三位病理科医生完成像素级标注。为应对实验变异和标注数据不足,提出结合标签传播的半监督学习(SSL)与多尺度相关信息原理(MPRI)及张量奇异谱分析法提取光谱-空间特征。仅使用每类1%的标注像素,SSL-MPRI方法在HSI数据集上达到微平均平衡准确率(BACC)0.9313、微平均F1分数0.9235;对应RGB图像的性能分别为0.8809和0.8688,差异具有统计显著性。该方法优于六种深度学习架构在63%标注数据下的表现。数据与代码已公开于https://github.com/ikopriva/ColonCancerHSI。
原文摘要 · Abstract (English)
Hyperspectral imaging (HSI) holds significant potential for transforming the field of computational pathology. However, there is currently a shortage of pixel-wise annotated HSI data necessary for training deep learning (DL) models. Additionally, the number of HSI-based research studies remains limited, and in many cases, the advantages of HSI over traditional RGB imaging have not been conclusively demonstrated, particularly for specimens collected intraoperatively. To address these challenges we present a database consisted of 27 HSIs of hematoxylin-eosin stained frozen sections, collected from 14 patients with colon adenocarcinoma metastasized to the liver. It is aimed to validate pixel-wise classification for intraoperative tumor resection. The HSIs were acquired in the spectral range of 450 to 800 nm, with a resolution of 1 nm, resulting in images of 1384x1035 pixels. Pixel-wise annotations were performed by three pathologists. To overcome challenges such as experimental variability and the lack of annotated data, we combined label-propagation-based semi-supervised learning (SSL) with spectral-spatial features extracted by: the multiscale principle of relevant information (MPRI) method and tensor singular spectrum analysis method. Using only 1% of labeled pixels per class the SSL-MPRI method achieved a micro balanced accuracy (BACC) of 0.9313 and a micro F1-score of 0.9235 on the HSI dataset. The performance on corresponding RGB images was lower, with a micro BACC of 0.8809 and a micro F1-score of 0.8688. These improvements are statistically significant. The SSL-MPRI approach outperformed six DL architectures trained with 63% of labeled pixels. Data and code are available at: https://github.com/ikopriva/ColonCancerHSI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。