提出通用流数据模式采样方法,实现高效在线学习。
RPS: A Generic Reservoir Patterns Sampler
- 用加权蓄水池直接从流数据中采样复杂模式
- 在真实数据集上构建准确的增量分类器,性能接近离线基准
- 适合需要实时处理序列与加权项集的在线学习场景
由于数据流持续快速演变,从流数据中高效学习对现代数据分析至关重要。尽管流模式挖掘已有显著进展,但在处理序列和加权项集等复杂数据流方面仍存在挑战。蓄水池采样虽是流数据中随机选取固定大小样本的基础方法,但其在复杂模式上的应用仍不充分。本文提出一种利用加权蓄水池直接从流批数据中采样模式的方法,确保可扩展性与效率。我们设计了一种通用算法,能缓解时间偏差并支持多种模式类型,包括序列、加权与无权重项集。在真实数据集上的全面实验表明,该方法能构建出高精度的增量在线分类器。本方法使以往无法用于序列数据的在线学习模型达到与离线基线相当的准确率,推动了增量在线序列项集分类器的发展。
原文摘要 · Abstract (English)
Efficient learning from streaming data is important for modern data analysis due to the continuous and rapid evolution of data streams. Despite significant advancements in stream pattern mining, challenges persist, particularly in managing complex data streams like sequential and weighted itemsets. While reservoir sampling serves as a fundamental method for randomly selecting fixed-size samples from data streams, its application to such complex patterns remains largely unexplored. In this study, we introduce an approach that harnesses a weighted reservoir to facilitate direct pattern sampling from streaming batch data, thus ensuring scalability and efficiency. We present a generic algorithm capable of addressing temporal biases and handling various pattern types, including sequential, weighted, and unweighted itemsets. Through comprehensive experiments conducted on real-world datasets, we evaluate the effectiveness of our method, showcasing its ability to construct accurate incremental online classifiers for sequential data. Our approach not only enables previously unusable online machine learning models for sequential data to achieve accuracy comparable to offline baselines but also represents significant progress in the development of incremental online sequential itemset classifiers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。