arXiv:2409.10996cs.LG2024-09被引 1

提出首个融合信息瓶颈与原型的可解释时序图回归框架

GINTRIP: Interpretable Temporal Graph Regression using Information bottleneck and Prototype-based method

  • 结合信息瓶颈与原型学习,提升时序图模型可解释性
  • 在交通与犯罪数据上实现更低的MAE/RMSE/MAPE,且解释力更强
  • 适合关注模型透明度与复杂时序图任务的研究者

深度神经网络在多个领域表现卓越,但其复杂性导致难以解释,尤其在包含复杂时空模式的时序图回归任务中更为突出。尽管图神经网络存在类似问题,目前尚无工作系统解决时序图神经网络的可解释性。原型方法等新思路虽有助于提升可解释性,但尚未有研究将原型方法与信息瓶颈(IB)原则结合用于时序图任务。本文提出GINTRIP框架,首次将两者融合,用于可解释的时序图回归。核心贡献包括:构建首个结合IB与原型方法的时序图可解释框架;推导出适用于图回归任务的互信息新理论界;引入无监督辅助分类头,通过多任务学习促进多样化概念表示。在真实数据集(如交通、犯罪)上的实验表明,该模型在预测精度(MAE, RMSE, MAPE)和解释性指标(如保真度)上均优于现有方法。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) have demonstrated remarkable performance across various domains, but their inherent complexity makes them challenging to interpret. This is especially true for temporal graph regression tasks due to the complex underlying spatio-temporal patterns in the graph. While interpretability concerns in Graph Neural Networks (GNNs) mirror those of DNNs, no notable work has addressed the interpretability of temporal GNNs to the best of our knowledge. Innovative methods, such as prototypes, aim to make DNN models more interpretable. However, a combined approach based on prototype-based methods and Information Bottleneck (IB) principles has not yet been developed for temporal GNNs. Our research introduces a novel approach that uniquely integrates these techniques to enhance the interpretability of temporal graph regression models. The key contributions of our work are threefold: We introduce the Graph INterpretability in Temporal Regression task using Information bottleneck and Prototype (GINTRIP) framework, the first combined application of IB and prototype-based methods for interpretable temporal graph tasks. We derive a novel theoretical bound on mutual information (MI), extending the applicability of IB principles to graph regression tasks. We incorporate an unsupervised auxiliary classification head, fostering diverse concept representation using multi-task learning, which enhances the model's interpretability. Our model is evaluated on real-world datasets like traffic and crime, outperforming existing methods in both forecasting accuracy and interpretability-related metrics such as MAE, RMSE, MAPE, and fidelity.

时序图可解释性信息瓶颈原型学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。