Histo-Miner可自动分析皮肤癌切片,提取关键细胞特征预测免疫治疗效果。
Histo-Miner: Deep learning based tissue features extraction pipeline from H&E whole slide images of cutaneous squamous cell carcinoma

- 基于CNN与视觉Transformer,自动分割和分类癌细胞核及肿瘤区域。
- 在47,392个细胞核和144张切片上实现0.569的核分割质量、0.907的肿瘤分割准确率。
- 可提取淋巴细胞比例等生物特征,用于预测患者对免疫疗法的响应。
数字病理学的发展使得高分辨率组织切片图像的全面分析成为可能。然而,针对皮肤组织的标注数据集和开源分析工具仍显不足。本文提出Histo-Miner,一种用于皮肤鳞状细胞癌(cSCC)全切片图像(WSI)分析的深度学习流程,并构建了两个标注数据集:包含47,392个注释细胞核,以及144个已分割肿瘤区域的WSI。该流程采用卷积神经网络与视觉变压器进行细胞核分割与分类、肿瘤区域分割,模型表现优于现有方法——核分割多类别全景质量(mPQ)达0.569,核分类宏平均F1为0.832,肿瘤分割平均交并比(mIoU)为0.907。基于预测结果生成紧凑的组织形态与细胞互作特征向量,可用于下游任务。本文进一步利用45例患者的治疗前WSI,使用Histo-Miner预测免疫治疗反应,识别出肿瘤微环境中淋巴细胞占比、粒细胞/淋巴细胞比值及粒细胞与浆细胞距离等关键预测特征,展现其在临床场景中的实用性与生物学可解释性。
原文摘要 · Abstract (English)
Recent advancements in digital pathology have enabled comprehensive analysis of Whole-Slide Images (WSI) from tissue samples, leveraging high-resolution microscopy and computational capabilities. Despite this progress, there is a lack of labeled datasets and open source pipelines specifically tailored for analysis of skin tissue. Here we propose Histo-Miner, a deep learning-based pipeline for analysis of skin WSIs and generate two datasets with labeled nuclei and tumor regions. We develop our pipeline for the analysis of patient samples of cutaneous squamous cell carcinoma (cSCC), a frequent non-melanoma skin cancer. Utilizing the two datasets, comprising 47,392 annotated cell nuclei and 144 tumor-segmented WSIs respectively, both from cSCC patients, Histo-Miner employs convolutional neural networks and vision transformers for nucleus segmentation and classification as well as tumor region segmentation. Performance of trained models positively compares to state of the art with multi-class Panoptic Quality (mPQ) of 0.569 for nucleus segmentation, macro-averaged F1 of 0.832 for nucleus classification and mean Intersection over Union (mIoU) of 0.907 for tumor region segmentation. From these predictions we generate a compact feature vector summarizing tissue morphology and cellular interactions, which can be used for various downstream tasks. Here, we use Histo-Miner to predict cSCC patient response to immunotherapy based on pre-treatment WSIs from 45 patients. Histo-Miner identifies percentages of lymphocytes, the granulocyte to lymphocyte ratio in tumor vicinity and the distances between granulocytes and plasma cells in tumors as predictive features for therapy response. This highlights the applicability of Histo-Miner to clinically relevant scenarios, providing direct interpretation of the classification and insights into the underlying biology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。