arXiv:2608.09834cs.CLcs.LG2026-08

用规则特征增强小模型,提升金融新闻情感分析精度

RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification

  • 将VADER规则特征与LoRA微调结合,仅增1024个可训练参数
  • 在测试集上准确率69.89%,中性类召回率达45.45%
  • 适合资源受限场景,支持CPU/GPU部署

金融情感分析将非结构化财经新闻转化为量化信号,辅助市场研判。现有轻量级金融NLP研究多聚焦于压缩或适配预训练模型,较少关注上下文表示与轻量规则特征的融合。本文提出规则感知的FinBERT(RA-FinBERT),通过低秩适配(LoRA)结合三个连续的VADER衍生情感比例(正、负、中性)及来源元数据特征。标准化后的四维特征向量与768维的FinBERT [CLS] 表示直接拼接,输入轻量分类头。相比结构匹配的纯文本FinBERT,该设计仅增加1,024个可训练参数。在财经新闻标题与描述的三分类情感任务上,RA-FinBERT在测试集上达到69.89%准确率和0.634宏平均F1,优于纯文本FinBERT的63.44%和0.526;中性类别召回率从18.18%提升至45.45%。框架支持CPU与GPU运行,为计算资源受限下的金融情感分类提供轻量且实用的解决方案。结果表明,规则衍生的情感信息与来源元数据可作为上下文表示的有效补充,以极低模型复杂度提升性能。

原文摘要 · Abstract (English)

Financial sentiment analysis converts unstructured financial news into quantitative signals that can support market analysis and decision-making. Existing work on resource-efficient financial NLP has largely focused on compressing or adapting pretrained language models, with less attention to combining contextual representations with lightweight rule-derived features. This study develops Rule-Aware FinBERT (RA-FinBERT), a parameter-efficient framework that integrates low-rank adaptation (LoRA) with three continuous VADER-derived sentiment proportions (positive, negative, and neutral) and a source-level metadata feature. The standardized four-dimensional feature vector is directly concatenated with the 768-dimensional final-layer FinBERT [CLS] representation and passed through a lightweight classification head. This design introduces only 1,024 additional trainable weights relative to a structurally matched text-only FinBERT model. RA-FinBERT was evaluated against text-only FinBERT and a lightweight DistilBERT baseline for three-class sentiment classification of financial-news titles and descriptions. On the held-out test set, RA-FinBERT achieved 69.89% accuracy and a macro F1 score of 0.634, compared with 63.44% and 0.526 for text-only FinBERT. Neutral-class recall increased from 18.18% to 45.45%. The framework supports both CPU and GPU execution, offering a lightweight and practical approach to financial sentiment classification under constrained computational resources. These findings indicate that rule-derived sentiment information and source metadata can provide complementary signals to contextual FinBERT representations and improve performance with minimal additional model complexity.

情感分析轻量模型金融NLPLoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。