融合隐式与显式关系建模,提升皮肤病变图像分类准确率
Integrating Implicit and Explicit Relational Biases through Graph-Based Multiple Instance Learning: A Case Study in Skin Lesion Diagnosis

- 用自监督重建学习图像块间隐式关系,再构建图结构显式传递信息
- 在ISIC-2018上达79.27%平衡准确率,较基线提升3.1个百分点
- 适合关注医学图像中结构关系建模的研究者与临床辅助诊断开发者
关系归纳偏置对于捕捉数据间的结构依赖至关重要。本研究提出一种双层次关系框架用于图像分类,弥合了隐式表示学习与显式结构建模之间的差距。首先以EfficientNetB3为基线,采用基于图像块的策略,利用卷积掩码自编码器通过自监督重建学习隐式的块间关系。随后引入显式关系建模,将学习到的嵌入组织成网格、随机和k近邻等多种图拓扑结构。在ISIC-2018和ISIC-2019皮肤病变诊断基准上的实验结果表明,结合隐式块间建模与显式图消息传递可获得最佳性能。在ISIC-2018测试集上,基线模型平衡准确率为76.17%,隐式建模提升至77.12%,全集成的网格结构图注意力网络进一步提高至79.27%。在ISIC-2019上,隐式方法达59.84%平衡准确率,结合显式建模后提升至60.67%。
原文摘要 · Abstract (English)
Relational inductive biases are essential for capturing structural dependencies among data. This study investigates a dual-level relational framework for image classification, bridging the gap between implicit representation learning and explicit structural modelling. We begin by establishing a baseline using an EfficientNetB3 architecture. To move beyond standard convolutional biases, we adopt a patch-based strategy, employing a convolutional masked autoencoder to learn implicit inter-patch relationships through self-supervised reconstruction. We then extend this approach by incorporating explicit relational modelling, organizing the learned embeddings into various graph topologies, including grid-based, random, and k-nearest neighbour structures. Experimental results on the ISIC-2018 and ISIC-2019 skin lesion diagnosis benchmarks show that combining implicit inter-patch modelling with explicit graph-based message passing yields the best performance. On the ISIC-2018 test set, the baseline model achieves a balanced accuracy of 76.17%, which improves to 77.12% with implicit patch-based relational modelling. The fully integrated grid-structured Graph Attention Network further increases performance to 79.27%. Similarly, on ISIC-2019, the implicit approach reaches 59.84% balanced accuracy, while the combination of implicit and explicit modelling yields 60.67%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。