arXiv:2512.00946cs.CLcs.AI2025-12被引 1

轻量开源大模型仅用5%数据就能高效处理多源金融文本情感分析。

Fine-tuning of lightweight large language models for sentiment classification on heterogeneous financial textual data

  • 用5%数据微调轻量开源模型,实现跨数据源情感分类。
  • Qwen3 8B和Llama3 8B在少样本下表现优于FinBERT。
  • 适合资源有限的研究者做金融文本情绪分析。

大型语言模型(LLMs)在金融市场分析中日益重要,能从推文、新闻、报告和微博等异构文本中捕捉信号。但其性能依赖大规模计算资源和专有数据集,成本高且难获取。为此,我们研究了轻量级开源LLM在不同规模、来源、格式和语言的金融文本数据上的泛化能力。对比FinBERT与三个开源轻量模型(DeepSeek-LLM 7B、Llama3 8B Instruct、Qwen3 8B),在五个公开数据集(FinancialPhraseBank、Financial Question Answering、Gold News Sentiment、Twitter Sentiment、Chinese Finance Sentiment)上测试。结果表明,尤其是Qwen3 8B和Llama3 8B,在仅使用5%训练数据时仍表现最佳,零样本和少样本场景下均稳定有效。说明轻量开源模型即使在有限标注数据下,也能实现媲美主流模型的性能,是成本可控的实用方案。

原文摘要 · Abstract (English)

Large language models (LLMs) play an increasingly important role in financial markets analysis by capturing signals from complex and heterogeneous textual data sources, such as tweets, news articles, reports, and microblogs. However, their performance is dependent on large computational resources and proprietary datasets, which are costly, restricted, and therefore inaccessible to many researchers and practitioners. To reflect realistic situations we investigate the ability of lightweight open-source LLMs -- smaller and publicly available models designed to operate with limited computational resources -- to generalize sentiment understanding from financial datasets of varying sizes, sources, formats, and languages. We compare the benchmark finance natural language processing (NLP) model, FinBERT, and three open-source lightweight LLMs, DeepSeek-LLM 7B, Llama3 8B Instruct, and Qwen3 8B on five publicly available datasets: FinancialPhraseBank, Financial Question Answering, Gold News Sentiment, Twitter Sentiment and Chinese Finance Sentiment. We find that LLMs, specially Qwen3 8B and Llama3 8B, perform best in most scenarios, even from using only 5% of the available training data. These results hold in zero-shot and few-shot learning scenarios. Our findings indicate that lightweight, open-source large language models (LLMs) constitute a cost-effective option, as they can achieve competitive performance on heterogeneous textual data even when trained on only a limited subset of the extensive annotated corpora that are typically deemed necessary.

情感分析轻量模型金融NLP少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。