用大模型与罗伯塔融合提升金融新闻分类,低数据下效果更优。
LabelFusion: Fusing Large Language Models with Transformer Encoders for Robust Financial News Classification
- 将提示工程的大模型输出与微调罗伯塔的上下文嵌入结合,通过轻量MLP投票层融合。
- 全数据训练时宏F1达96.0%,高于单独罗伯塔(94.6%)和大模型(93.9%)。
- 在低数据场景下,仅用提示的大模型表现优于融合模型,适合标注受限场景。
金融新闻对投资者情绪和大宗商品市场短期波动具有核心影响。许多下游金融应用,如商品价格预测或情感建模,依赖于自动识别与特定资产相关的新闻文章。然而,获取大规模标注的金融文本分类语料成本高昂,基于Transformer的分类器如RoBERTa在低数据条件下性能显著下降。结果显示,经过适当提示的现成大型语言模型(LLM)在低数据环境下仍能取得良好表现。我们提出LabelFusion,一种混合架构:将提示工程后的LLM输出与微调后RoBERTa编码器生成的上下文嵌入,通过轻量级多层感知机(MLP)投票层进行融合。在Reuters-21578数据集的十类多标签子集上评估,当使用完整数据集训练时,LabelFusion达到96.0%的宏F1和92.3%的准确率,优于独立的RoBERTa(F1 94.6%)和独立大模型(F1 93.9%)。但在低至中等数据规模下,仅使用提示的大模型表现惊人,即使在零样本设置下也能达到75.9%的F1,且在约80%训练数据前持续优于LabelFusion。结果表明,在标注资源受限时,纯大模型提示策略更优;而一旦有足够标注数据训练编码器,LabelFusion成为最优方案。代码已开源。
原文摘要 · Abstract (English)
Financial news plays a central role in shaping investor sentiment and short-term dynamics in commodity markets. Many downstream financial applications, such as commodity price prediction or sentiment modeling, therefore rely on the ability to automatically identify news articles relevant to specific assets. However, obtaining large labeled corpora for financial text classification is costly, and transformer-based classifiers such as RoBERTa often degrade significantly in low-data regimes. Our results show that appropriately prompted out-of-the-box Large Language Models (LLMs) achieve strong performance even in such settings. Furthermore, we propose LabelFusion, a hybrid architecture that combines the output of a prompt-engineered LLM with contextual embeddings produced by a fine-tuned RoBERTa encoder through a lightweight Multilayer Perceptron (MLP) voting layer. Evaluated on a ten-class multi-label subset of the Reuters-21578 corpus, LabelFusion achieves a macro F1 score of 96.0% and an accuracy of 92.3% when trained on the full dataset, outperforming both standalone RoBERTa (F1 94.6%) and the standalone LLM (F1 93.9%). In low- to mid-data regimes, however, the LLM alone proves surprisingly competitive, achieving an F1 score of 75.9% even in a zero-shot setting and consistently outperforming LabelFusion until approximately 80% of the training data is available. These results suggest that LLM-only prompting is the preferred strategy under annotation constraints, whereas LabelFusion becomes the most effective solution once sufficient labeled data is available to train the encoder component. The code is available in an anonymized repository.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。