将可解释的逻辑规则扩展到图结构,实现高效深度学习。
The Tsetlin Machine Goes Deep: Logical Learning and Reasoning With Graphs
- 用消息传递构建嵌套深层逻辑规则,处理图数据
- 图像分类准确率比卷积TM高3.86个百分点
- 适合需要可解释性的复杂场景,如生物序列分析
基于简洁扁平的与规则,Tsetlin机(TM)兼具可解释性与高效性,其强化学习机制在越来越多的数据集上达到与深度学习相当的精度。本文提出图Tsetlin机(GraphTM),用于从图结构输入中学习可解释的深层逻辑规则。突破传统固定长度输入限制,GraphTM支持序列、网格、关系及多模态数据。通过消息传递机制,构建嵌套深层规则以识别子图模式,所需规则数量呈指数级减少,显著提升可解释性与数据利用率。在图像分类任务中,GraphTM保持可解释性的同时,在CIFAR-10上比卷积式TM高出3.86个百分点;在动作核心指代追踪任务中,面对日益挑战性的任务,性能优于其他强化学习方法达20.6个百分点;在推荐系统中,对噪声有较强鲁棒性,接近GCN表现;在病毒基因组序列数据上,其精度与BiLSTM-CNN和GCN相当,训练速度比GCN快约2.5倍。该模型在多个领域的应用展示了图表示学习与深层逻辑规则结合为TM带来的新可能。
原文摘要 · Abstract (English)
Pattern recognition with concise and flat AND-rules makes the Tsetlin Machine (TM) both interpretable and efficient, while the power of Tsetlin automata enables accuracy comparable to deep learning on an increasing number of datasets. We introduce the Graph Tsetlin Machine (GraphTM) for learning interpretable deep clauses from graph-structured input. Moving beyond flat, fixed-length input, the GraphTM gets more versatile, supporting sequences, grids, relations, and multimodality. Through message passing, the GraphTM builds nested deep clauses to recognize sub-graph patterns with exponentially fewer clauses, increasing both interpretability and data utilization. For image classification, GraphTM preserves interpretability and achieves 3.86%-points higher accuracy on CIFAR-10 than a convolutional TM. For tracking action coreference, faced with increasingly challenging tasks, GraphTM outperforms other reinforcement learning methods by up to 20.6%-points. In recommendation systems, it tolerates increasing noise to a great extent, similar to a GCN. Finally, for viral genome sequence data, GraphTM is competitive with BiLSTM-CNN and GCN accuracy-wise, training ~2.5x faster than GCN. The GraphTM's application to these varied fields demonstrates how graph representation learning and deep clauses bring new possibilities for TM learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。