用高光谱成像+3D神经网络实现腮腺手术中组织自动识别,准确率达98.7%。
Automatic Tissue Differentiation in Parotidectomy using Hyperspectral Imaging
- 用400-1000nm高光谱数据训练3D CNN模型进行组织分类。
- 验证集准确率98.7%,测试集达83.4%,对神经和腺体敏感度高。
- 适合需术中实时组织辨识的头颈外科医生参考使用。
在头颈部手术中,持续的术中组织区分对避免神经、血管等重要结构损伤至关重要。本研究利用高光谱成像(HSI)结合神经网络分析,辅助外科医生进行组织识别。采用波长范围为400–1000 nm的3D卷积神经网络,系统由两台多光谱快照相机构成立体式HSI装置。分析基于18例接受腮腺切除术患者的27幅标注图像,涵盖腺体组织、神经、肌肉、皮肤和静脉。根据留一患者排除法,剔除3名患者用于评估,其余数据随机划分为训练集与验证集。验证阶段总体准确率达98.7%,表明模型训练稳健;在排除患者的评估中,总体准确率为83.4%,展现出良好的检测与识别能力。结果表明,高光谱成像可实现可靠的术中组织区分,尤其在腮腺及神经组织上表现出高敏感性。值得注意的是,静脉常被误判为肌肉,提示需更全面的数据基础,这对手术场景中的应用构成重大挑战。
原文摘要 · Abstract (English)
In head and neck surgery, continuous intraoperative tissue differentiation is of great importance to avoid injury to sensitive structures such as nerves and vessels. Hyperspectral imaging (HSI) with neural network analysis could support the surgeon in tissue differentiation. A 3D Convolutional Neural Network with hyperspectral data in the range of $400-1000$ nm is used in this work. The acquisition system consisted of two multispectral snapshot cameras creating a stereo-HSI-system. For the analysis, 27 images with annotations of glandular tissue, nerve, muscle, skin and vein in 18 patients undergoing parotidectomy are included. Three patients are removed for evaluation following the leave-one-subject-out principle. The remaining images are used for training, with the data randomly divided into a training group and a validation group. In the validation, an overall accuracy of $98.7\%$ is achieved, indicating robust training. In the evaluation on the excluded patients, an overall accuracy of $83.4\%$ has been achieved showing good detection and identification abilities. The results clearly show that it is possible to achieve robust intraoperative tissue differentiation using hyperspectral imaging. Especially the high sensitivity in parotid or nerve tissue is of clinical importance. It is interesting to note that vein was often confused with muscle. This requires further analysis and shows that a very good and comprehensive data basis is essential. This is a major challenge, especially in surgery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。