用注意力图解释牙齿3D模型分类,提升医疗AI可信度
Attention Maps in 3D Shape Classification for Dental Stage Estimation with Class Node Graph Attention Networks
- 构建图注意力网络,通过节点特征与全局节点建模决策过程
- 结合局部曲率与距中心距离特征,达0.76加权F1分数
- 生成可解释的注意力热图,适合医疗等高风险场景使用
深度学习在医学和法医等领域的识别任务中展现出巨大潜力,但其黑箱特性限制了在高风险场景中的应用。针对3D牙齿形状识别,本文提出类节点图注意力网络(CGAT),基于锥形束CT图像生成的第三磨牙3D网格,实现Demirjian分期自动判定。CGAT采用图注意力卷积与内嵌注意力机制,通过注意力传播可视化决策路径。评估了局部平均曲率和距中心节点距离作为节点特征的单独及组合效果,以及模型深度的影响。结果表明,引入指向全局CLS节点的有向边能生成更直观的注意力图,并保持良好分类性能。结合两种特征时,加权F1得分为0.76,且注意力可视化更全面。该架构可生成人类可理解的注意力图,增强模型信任度,便于专家验证。尽管应用于牙科数据,CGAT可广泛用于基于图的分类与回归任务,推动透明且高性能深度学习在高风险环境中的应用。
原文摘要 · Abstract (English)
Deep learning offers a promising avenue for automating many recognition tasks in fields such as medicine and forensics. However, the black-box nature of these models hinders their adoption in high-stakes applications where trust and accountability are required. For 3D shape recognition tasks in particular, this paper introduces the Class Node Graph Attention Network (CGAT) architecture to address this need. Applied to 3D meshes of third molars derived from CBCT images, for Demirjian stage allocation, CGAT utilizes graph attention convolutions and an inherent attention mechanism, visualized via attention rollout, to explain its decision-making process. We evaluated the local mean curvature and distance to centroid node features, both individually and in combination, as well as model depth, finding that models incorporating directed edges to a global CLS node produced more intuitive attention maps, while also yielding desirable classification performance. We analyzed the attention-based explanations of the models, and their predictive performances to propose optimal settings for the CGAT. The combination of local mean curvature and distance to centroid as node features yielded a slight performance increase with 0.76 weighted F1 score, and more comprehensive attention visualizations. The CGAT architecture's ability to generate human-understandable attention maps can enhance trust and facilitate expert validation of model decisions. While demonstrated on dental data, CGAT is broadly applicable to graph-based classification and regression tasks, promoting wider adoption of transparent and competitive deep learning models in high-stakes environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。