用偏好优化提升金融情感分析,让大模型更懂市场情绪。
FinDPO: Financial Sentiment Analysis for Algorithmic Trading through Preference Optimization of LLMs
- 通过直接偏好优化对齐人类偏好,避免数据记忆问题。
- 在标准数据集上比传统方法高11%准确率,年化收益达67%。
- 将情感判断转为连续得分,可直接用于真实投资策略设计。
在线金融文本中的观点正日益深刻影响交易决策与市场走势,凸显情感分析在量化意见性质与强度中的关键作用。随着生成式AI的发展,监督微调的大语言模型已成为金融情感分析的主流方法。然而,该范式易导致训练数据记忆,难以泛化至未见样本,这在需应对突发事件与领域特有语境的金融场景中尤为关键。为此,本文提出首个基于直接偏好优化(DPO)的金融领域专用大模型框架FinDPO。FinDPO在标准情感分类基准上达到领先性能,平均优于现有监督微调模型11%。独特之处在于,该框架创新性地将微调后的因果大模型与真实投资组合策略结合,通过‘逻辑值转分数’机制,将离散情感预测转化为连续可排序的情感得分(概率)。实证模拟显示,该方法首次实现年化正收益67%,风险调整后表现优异,夏普比率达2.0,即使在5基点真实交易成本下仍保持稳健。
原文摘要 · Abstract (English)
Opinions expressed in online finance-related textual data are having an increasingly profound impact on trading decisions and market movements. This trend highlights the vital role of sentiment analysis as a tool for quantifying the nature and strength of such opinions. With the rapid development of Generative AI (GenAI), supervised fine-tuned (SFT) large language models (LLMs) have become the de facto standard for financial sentiment analysis. However, the SFT paradigm can lead to memorization of the training data and often fails to generalize to unseen samples. This is a critical limitation in financial domains, where models must adapt to previously unobserved events and the nuanced, domain-specific language of finance. To this end, we introduce FinDPO, the first finance-specific LLM framework based on post-training human preference alignment via Direct Preference Optimization (DPO). The proposed FinDPO achieves state-of-the-art performance on standard sentiment classification benchmarks, outperforming existing supervised fine-tuned models by 11% on the average. Uniquely, the FinDPO framework enables the integration of a fine-tuned causal LLM into realistic portfolio strategies through a novel 'logit-to-score' conversion, which transforms discrete sentiment predictions into continuous, rankable sentiment scores (probabilities). In this way, simulations demonstrate that FinDPO is the first sentiment-based approach to maintain substantial positive returns of 67% annually and strong risk-adjusted performance, as indicated by a Sharpe ratio of 2.0, even under realistic transaction costs of 5 basis points (bps).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。