arXiv:2510.23464cs.CLcs.AI2025-10被引 1

用大模型分析财报和电话会文本中的财务立场,无需大量标注数据。

Evaluating Large Language Models for Stance Detection on Financial Targets from SEC Filing Reports and Earnings Call Transcripts

  • 用ChatGPT-o3-pro+人工验证构建三类财务指标的立场标注语料
  • 少样本+思维链提示在零样本和监督基线中表现最优
  • 适用于想低成本做财务态度分析的研究者和从业者

美国证券交易委员会(SEC)的10-K年报和季度业绩电话会转录文本对投资者、审计师和监管机构至关重要。但其篇幅长、专业术语多、语言微妙,精细分析困难。以往金融领域的情感分析需大量昂贵的标注数据,难以实现针对特定财务目标的句子级立场识别。本文构建了一个面向债务、每股收益(EPS)和销售额三个核心指标的句子级立场检测语料库,数据来自10-K报告和业绩电话会转录文本,并通过先进的ChatGPT-o3-pro模型结合严格的人工验证进行立场标注(正向、负向、中性)。基于该语料库,系统评估了现代大语言模型在零样本、少样本及思维链(CoT)提示策略下的表现。结果表明,少样本配合思维链提示优于监督基线,且不同模型在SEC与电话会数据集上的表现存在差异。研究证实,无需大量标注数据即可利用大模型实现金融领域特定目标的立场分析,具有实际可行性。

原文摘要 · Abstract (English)

Financial narratives from U.S. Securities and Exchange Commission (SEC) filing reports and quarterly earnings call transcripts (ECTs) are very important for investors, auditors, and regulators. However, their length, financial jargon, and nuanced language make fine-grained analysis difficult. Prior sentiment analysis in the financial domain required a large, expensive labeled dataset, making the sentence-level stance towards specific financial targets challenging. In this work, we introduce a sentence-level corpus for stance detection focused on three core financial metrics: debt, earnings per share (EPS), and sales. The sentences were extracted from Form 10-K annual reports and ECTs, and labeled for stance (positive, negative, neutral) using the advanced ChatGPT-o3-pro model under rigorous human validation. Using this corpus, we conduct a systematic evaluation of modern large language models (LLMs) using zero-shot, few-shot, and Chain-of-Thought (CoT) prompting strategies. Our results show that few-shot with CoT prompting performs best compared to supervised baselines, and LLMs' performance varies across the SEC and ECT datasets. Our findings highlight the practical viability of leveraging LLMs for target-specific stance in the financial domain without requiring extensive labeled data.

大模型财务分析立场检测零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。