将皮肤镜图像转为图结构,用图神经网络检测异常,效果优于传统方法。
From Pixels to Graphs: Deep Graph-Level Anomaly Detection on Dermoscopic Images
- 通过分割、特征提取和边连接构建图像图表示,系统评估不同转换策略
- 无监督下最高AUC-ROC达0.805,半监督提升至0.872,全监督达0.914
- 颜色特征单独表现最佳,融合形状与纹理特征可进一步提升检测能力
图神经网络(GNN)在基于图的机器学习任务中表现出强大性能。以往研究将GNN应用于图像生成的图表示,用于分类或异常检测等下游任务,通常包括图像分割、段落特征提取、映射为节点并建立连接。然而,据我们所知,尚无研究系统比较多种图像到图转换方法在基于GNN的图级异常检测(GLAD)中的有效性。本研究系统评估了多种分割方案、边构建策略及基于颜色、纹理和形状描述符的节点特征集,以生成适用于图级异常检测的图像衍生图表示。我们在皮肤镜图像上使用最先进的GLAD模型进行广泛实验,考察了纯无监督、弱监督和全监督三种场景下的性能与效率。结果表明,颜色描述符单独使用时表现最优,而结合形状与纹理特征能持续提升检测效果。特别地,采用OCGTL的最佳无监督配置在不依赖预训练主干网络的情况下,达到0.805的竞争力AUC-ROC;加入稀疏标签后性能显著提升至0.872,全监督下达0.914 AUC-ROC。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have emerged as a powerful approach for graph-based machine learning tasks. Previous work applied GNNs to image-derived graph representations for various downstream tasks such as classification or anomaly detection. These transformations include segmenting images, extracting features from segments, mapping them to nodes, and connecting them. However, to the best of our knowledge, no study has rigorously compared the effectiveness of the numerous potential image-to-graph transformation approaches for GNN-based graph-level anomaly detection (GLAD). In this study, we systematically evaluate the efficacy of multiple segmentation schemes, edge construction strategies, and node feature sets based on color, texture, and shape descriptors to produce suitable image-derived graph representations to perform graph-level anomaly detection. We conduct extensive experiments on dermoscopic images using state-of-the-art GLAD models, examining performance and efficiency in purely unsupervised, weakly supervised, and fully supervised regimes. Our findings reveal, for example, that color descriptors contribute the best standalone performance, while incorporating shape and texture features consistently enhances detection efficacy. In particular, our best unsupervised configuration using OCGTL achieves a competitive AUC-ROC score of up to 0.805 without relying on pretrained backbones like comparable image-based approaches. With the inclusion of sparse labels, the performance increases substantially to 0.872 and with full supervision to 0.914 AUC-ROC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。