从数据流中学习状态机,兼顾效率与理论保证
PAC learning PDFA from data streams
- 提出通用方法与合并启发式,用 sketches 处理不完整前缀树
- 在真实数据集上实现更快运行、更低内存、更优结果
- 首次提供 PAC 学习框架下的理论保证,适合流式学习场景
状态机模型可模拟离散事件系统,广泛用于软件、网络和控制系统建模。现有学习算法多假设数据全量可用,而对数据流场景研究不足。本文提出一种从数据流学习状态机的通用方法,并设计基于 sketches 的合并启发式,以应对不完整前缀树问题。我们在开源状态合并库中实现该方法,并在知名公开数据集上评估,结果表明其在运行时间、内存消耗和模型质量方面均优于现有方法。此外,本文提供了严格的 PAC 学习理论分析,证明该算法在大样本下具备学习能力,并实现了运行时间的理论优化,且不牺牲算法正确性。
原文摘要 · Abstract (English)
This is an extended version of our publication Learning state machines from data streams: A generic strategy and an improved heuristic, International Conference on Grammatical Inference (ICGI) 2023, Rabat, Morocco. It has been extended with a formal proof on PAC-bounds, and the discussion and analysis of a similar approach has been moved from the appendix and now has a full dedicated section. State machine models are models that simulate the behavior of discrete event systems, capable of representing systems such as software systems, network interactions, and control systems, and have been researched extensively. The nature of most learning algorithms however is the assumption that all data be available at the beginning of the algorithm, and little research has been done in learning state machines from streaming data. In this paper, we want to close this gap further by presenting a generic method for learning state machines from data streams, as well as a merge heuristic that uses sketches to account for incomplete prefix trees. We implement our approach in an open-source state merging library and compare it with existing methods. We show the effectiveness of our approach with respect to run-time, memory consumption, and quality of results on a well known open dataset. Additionally, we provide a formal analysis of our algorithm, showing that it is capable of learning within the PAC framework, and show a theoretical improvement to increase run-time, without sacrificing correctness of the algorithm in larger sample sizes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。