无需专家背景知识,自动生成正负样本训练逻辑程序。
Self-Supervised Inductive Logic Programming
- 自动生成正负例并动态更新,实现无监督引导的归纳逻辑编程
- 在语法学习任务中,生成更多样本后性能持续提升,超越对比模型
- 提出通用二阶背景理论框架,避免为每任务定制知识
归纳逻辑编程(ILP)方法如元解释学习(MIL)能从少量示例中学习到具有良好泛化能力的递归逻辑程序,并引入新谓词。这依赖于特定问题的背景知识和负例,均需领域专家精心设计。但若缺乏此类先验信息怎么办?本文将此问题形式化为自监督归纳逻辑编程新范式,并提出一种新的MIL算法:仅需部分正例标签,零或少量未标注样例,即可在学习过程中自动生成并标注新的正负例。我们在Prolog中实现该算法,构建新系统Poker。在实验中,与当前最优的MIL系统Louise对比,使用上下文无关语言和L-系统语言的正例字符串进行语法学习,仅提供语言中出现的终结符词汇表作为一阶背景理论,无任何负例。我们引入一种基于二阶正规形式(SONF)的原理性方法,构建足够通用的二阶背景理论,可覆盖整个程序类别,从而消除对任务特异性背景理论的需求。结果表明,随着自动生成样本数量增加,Poker性能稳步提升;而Louise因缺乏负例,出现过拟合现象。
原文摘要 · Abstract (English)
Inductive Logic Programming (ILP) approaches like Meta \-/ Interpretive Learning (MIL) can learn, from few examples, recursive logic programs with invented predicates that generalise well to unseen instances. This ability relies on a background theory and negative examples, both carefully selected with expert knowledge of a learning problem and its solutions. But what if such a problem-specific background theory or negative examples are not available? We formalise this question as a new setting for Self-Supervised ILP and present a new MIL algorithm that learns in the new setting from some positive labelled, and zero or more unlabelled examples, and automatically generates, and labels, new positive and negative examples during learning. We implement this algorithm in Prolog in a new MIL system, called Poker. We compare Poker to state-of-the-art MIL system Louise on experiments learning grammars for Context-Free and L-System languages from labelled, positive example strings, no negative examples, and just the terminal vocabulary of a language, seen in examples, as a first-order background theory. We introduce a new approach for the principled selection of a second-order background theory as a Second Order Definite Normal Form (SONF), sufficiently general to learn all programs in a class, thus removing the need for a backgound theory tailored to a learning task. We find that Poker's performance improves with increasing numbers of automatically generated examples while Louise, bereft of negative examples, over-generalises.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。