用神经嵌入增强符号学习,提升分类性能
Enhancing Symbolic Machine Learning by Subsymbolic Representations
- 将神经嵌入引入符号学习系统TILDE,通过相似性谓词改进表示
- 在三个真实数据集上F1分数超越所有基线方法
- 适合需要符号可解释性又需高效学习的场景
神经符号AI旨在结合符号与子符号方法以克服各自局限。现有系统如逻辑张量网络(LTN)或DeepProbLog提供神经谓词和端到端学习,但其通用性导致在简单任务中效率低下,尤其在常量众多的领域。本文提出新思路:通过赋予符号学习系统访问神经嵌入的能力来增强其性能。以TILDE系统为例,利用常量的嵌入表示用于相似性谓词。该方法可通过符号理论进一步优化嵌入。在三个真实世界领域的实验中,该方法在F1分数上全面优于其他基线模型。该思路还可拓展至实例间相似性建模(类似逻辑语言中的核函数)、类比推理或命题化。
原文摘要 · Abstract (English)
The goal of neuro-symbolic AI is to integrate symbolic and subsymbolic AI approaches, to overcome the limitations of either. Prominent systems include Logic Tensor Networks (LTN) or DeepProbLog, which offer neural predicates and end-to-end learning. The versatility of systems like LTNs and DeepProbLog, however, makes them less efficient in simpler settings, for instance, for discriminative machine learning, in particular in domains with many constants. Therefore, we follow a different approach: We propose to enhance symbolic machine learning schemes by giving them access to neural embeddings. In the present paper, we show this for TILDE and embeddings of constants used by TILDE in similarity predicates. The approach can be fine-tuned by further refining the embeddings depending on the symbolic theory. In experiments in three real-world domain, we show that this simple, yet effective, approach outperforms all other baseline methods in terms of the F1 score. The approach could be useful beyond this setting: Enhancing symbolic learners in this way could be extended to similarities between instances (effectively working like kernels within a logical language), for analogical reasoning, or for propositionalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。