从约束条件中学习定量自动机,无需手动标注输入输出对。
Learning Quantitative Automata Modulo Theories
- 通过逻辑推理和约束集推导自动机结构
- 在有理数理论下成功学习四类定量自动机
- 适合偏好学习或排序数据的场景
定量自动机在建模序列概率分布、奖励机器等任务中具有重要应用。传统主动学习依赖显式输入输出样本,但获取这些样本成本高。在偏好学习或排序学习场景中,提供约束条件更自然高效。为此,本文提出从输入序列取值的约束集合中学习确定性定量自动机的问题。我们提出QUINTIC算法,通过假设的偏好模型与定量自动机类,结合理论推理解析现有约束,完成对自动机空间的完整搜索,保证结果最小且正确终止。实验基于有理数理论,学习了求和、折扣求和、乘积及分类型定量自动机,验证了该方法的有效性。
原文摘要 · Abstract (English)
Quantitative automata are useful representations for numerous applications, including modeling probability distributions over sequences to Markov chains and reward machines. Actively learning such automata typically occurs using explicitly gathered input-output examples under adaptations of the L-star algorithm. However, obtaining explicit input-output pairs can be expensive, and there exist scenarios, including preference-based learning or learning from rankings, where providing constraints is a less exerting and a more natural way to concisely describe desired properties. Consequently, we propose the problem of learning deterministic quantitative automata from sets of constraints over the valuations of input sequences. We present QUINTIC, an active learning algorithm, wherein the learner infers a valid automaton through deductive reasoning, by applying a theory to a set of currently available constraints and an assumed preference model and quantitative automaton class. QUINTIC performs a complete search over the space of automata, and is guaranteed to be minimal and correctly terminate. Our evaluations utilize theory of rationals in order to learn summation, discounted summation, product, and classification quantitative automata, and indicate QUINTIC is effective at learning these types of automata.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。