arXiv:2507.06901cs.LG2025-07被引 3

用强化学习动态调整数据流滑动窗口大小,提升实时处理效果

Designing Adaptive Algorithms Based on Reinforcement Learning for Dynamic Optimization of Sliding Window Size in Multi-Dimensional Data Streams

  • 将窗口大小优化建模为强化学习问题,智能体根据数据特征自适应调整
  • 在多个真实数据集上,分类准确率提升5.2%,对概念漂移的鲁棒性更强
  • 适合物联网、金融等高动态实时场景,兼顾精度与计算效率

多维数据流广泛存在于物联网、金融市场和实时分析等领域,因其高速度、无边界性和复杂的跨维度依赖关系带来挑战。滑动窗口技术是处理此类数据的关键,但固定大小窗口难以应对概念漂移或突发模式等动态变化。本文提出一种基于强化学习(RL)的新型方法,用于动态优化多维数据流的滑动窗口大小。通过将窗口选择建模为强化学习问题,智能体可依据数据特征(如方差、相关性、时间趋势)学习自适应策略。所提方法RL-Window采用带优先经验回放的双网络深度Q网络(Dueling DQN),有效应对非平稳性和高维度问题。在UCI HAR、PAMAP2、Yahoo! Finance Stream等基准数据集上的评估表明,相比ADWIN和CNN-Adaptive等先进方法,RL-Window在分类准确率、漂移鲁棒性和计算效率方面均有显著提升。额外的定性分析、扩展指标(如能耗、延迟)及全面的数据集表征进一步验证了其适应性与稳定性,适用于实时应用场景。

原文摘要 · Abstract (English)

Multi-dimensional data streams, prevalent in applications like IoT, financial markets, and real-time analytics, pose significant challenges due to their high velocity, unbounded nature, and complex inter-dimensional dependencies. Sliding window techniques are critical for processing such streams, but fixed-size windows struggle to adapt to dynamic changes like concept drift or bursty patterns. This paper proposes a novel reinforcement learning (RL)-based approach to dynamically optimize sliding window sizes for multi-dimensional data streams. By formulating window size selection as an RL problem, we enable an agent to learn an adaptive policy based on stream characteristics, such as variance, correlations, and temporal trends. Our method, RL-Window, leverages a Dueling Deep Q-Network (DQN) with prioritized experience replay to handle non-stationarity and high-dimensionality. Evaluations on benchmark datasets (UCI HAR, PAMAP2, Yahoo! Finance Stream) demonstrate that RL-Window outperforms state-of-the-art methods like ADWIN and CNN-Adaptive in classification accuracy, drift robustness, and computational efficiency. Additional qualitative analyses, extended metrics (e.g., energy efficiency, latency), and a comprehensive dataset characterization further highlight its adaptability and stability, making it suitable for real-time applications.

数据流强化学习自适应优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。