用注意力机制改进GRU,提升股市预测精度
MCI-GRU: Stock Prediction Model Based on Multi-Head Cross-Attention and Improved GRU
- 用多头交叉注意力替代重置门,灵活选择历史信息
- 学习市场隐含状态,融合时间与截面特征提升表现
- 在四大市场超主流模型,已用于实际基金运营
在大数据时代,金融市场的复杂性使得精准股市预测愈发重要。传统时间序列模型如GRU虽广泛应用,却难以捕捉市场的非线性动态,尤其在关键历史信息的选择与利用上存在不足。近期图神经网络和强化学习虽有潜力,但对数据质量要求高,且在数据稀疏和噪声下易不稳定,训练推理过程复杂且计算开销大。现有方法也普遍难以有效捕捉市场情绪、预期、微观结构及参与者行为等不可观测的隐含状态,影响对市场动态的理解,进而制约预测准确率。为此,本文提出基于多头交叉注意力和改进GRU的股票预测模型MCI-GRU。首先,通过将重置门替换为注意力机制,增强模型对历史信息的灵活选择与利用能力;其次,设计多头交叉注意力机制以学习不可观测的市场隐含状态表示,并通过与时间特征和截面特征的交互进一步丰富其表达。最后,在四个主要股票市场上的大量实验表明,该方法在多个指标上优于当前最优技术。此外,其在真实基金运营管理中的成功应用验证了模型的有效性与实用性。
原文摘要 · Abstract (English)
As financial markets grow increasingly complex in the big data era, accurate stock prediction has become more critical. Traditional time series models, such as GRUs, have been widely used but often struggle to capture the intricate nonlinear dynamics of markets, particularly in the flexible selection and effective utilization of key historical information. Recently, methods like Graph Neural Networks and Reinforcement Learning have shown promise in stock prediction but require high data quality and quantity, and they tend to exhibit instability when dealing with data sparsity and noise. Moreover, the training and inference processes for these models are typically complex and computationally expensive, limiting their broad deployment in practical applications. Existing approaches also generally struggle to capture unobservable latent market states effectively, such as market sentiment and expectations, microstructural factors, and participant behavior patterns, leading to an inadequate understanding of market dynamics and subsequently impact prediction accuracy. To address these challenges, this paper proposes a stock prediction model, MCI-GRU, based on a multi-head cross-attention mechanism and an improved GRU. First, we enhance the GRU model by replacing the reset gate with an attention mechanism, thereby increasing the model's flexibility in selecting and utilizing historical information. Second, we design a multi-head cross-attention mechanism for learning unobservable latent market state representations, which are further enriched through interactions with both temporal features and cross-sectional features. Finally, extensive experiments on four main stock markets show that the proposed method outperforms SOTA techniques across multiple metrics. Additionally, its successful application in real-world fund management operations confirms its effectiveness and practicality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。