用反思性证据微调让大模型独立分析股票走势,提升推理能力。
RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models
- 通过动态构建分析框架,系统组织和评分多方证据进行推理。
- 在5123只A股上验证,6个月后仍保持预测效果,对新股票有效。
- 适合金融研究者、量化分析师,解决大模型依赖上下文的问题。
大语言模型在数学与编程任务中表现优异,但在金融领域尤其是股票走势预测这一基础任务上仍研究不足。本文针对三分类问题(上涨、持有、下跌),分析发现:(1)模型倾向于跟随分析师观点而非独立逻辑推理;(2)虽列出多源信息却未权衡对立证据,影响可靠性。为此,提出反射性证据微调(RETuning),一种强化学习前的冷启动方法。该方法在生成思维链时,鼓励从多元信息源动态构建分析框架,依据框架组织并评分涨跌证据,而非依赖上下文观点,并通过反思得出预测。这使模型更贴近自身分析逻辑,减少上下文干扰。我们还构建了覆盖2024全年、包含5,123只A股的大型数据集,上下文长达32K tokens,样本超20万,涵盖价格、新闻、分析师意见、量化报告、基本面数据、宏观经济指标及相似股票。实验表明,RETuning成功激发模型在金融领域的推理潜力,即使在6个月后或面对分布外股票,推理时缩放依然有效,模型获得深层洞察。
原文摘要 · Abstract (English)
Recently, large language models (LLMs) have demonstrated outstanding reasoning capabilities on mathematical and coding tasks. However, their application to financial tasks-especially the most fundamental task of stock movement prediction-remains underexplored. We study a three-class classification problem (up, hold, down) and, by analyzing existing reasoning responses, observe that: (1) LLMs follow analysts' opinions rather than exhibit a systematic, independent analytical logic (CoTs). (2) LLMs list summaries from different sources without weighing adversarial evidence, yet such counterevidence is crucial for reliable prediction. It shows that the model does not make good use of its reasoning ability to complete the task. To address this, we propose Reflective Evidence Tuning (RETuning), a cold-start method prior to reinforcement learning, to enhance prediction ability. While generating CoT, RETuning encourages dynamically constructing an analytical framework from diverse information sources, organizing and scoring evidence for price up or down based on that framework-rather than on contextual viewpoints-and finally reflecting to derive the prediction. This approach maximally aligns the model with its learned analytical framework, ensuring independent logical reasoning and reducing undue influence from context. We also build a large-scale dataset spanning all of 2024 for 5,123 A-share stocks, with long contexts (32K tokens) and over 200K samples. In addition to price and news, it incorporates analysts' opinions, quantitative reports, fundamental data, macroeconomic indicators, and similar stocks. Experiments show that RETuning successfully unlocks the model's reasoning ability in the financial domain. Inference-time scaling still works even after 6 months or on out-of-distribution stocks, since the models gain valuable insights about stock movement prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。