arXiv:2410.07118cs.CL2024-10被引 5

用小模型让普通人也能轻松问金融问题,降低理财门槛。

Exploring the Readiness of Prominent Small Language Models for the Democratization of Financial Literacy

  • 测试多个开源小模型在金融问答中的表现,评估可用性与效果。
  • 部分模型零样本和少样本下已能生成可读性强的准确答案。
  • 适合教育机构、个人用户及隐私敏感者使用,推动金融普惠。

小语言模型(SLMs,参数量小于30亿)因其可在普通硬件运行并保护用户隐私,有潜力实现语言模型的普惠化。本研究首次评估主流开源SLMs(如Apple OpenELM、Microsoft Phi、Google Gemma、TinyLlama)在金融领域的应用能力,旨在支持金融素养类语言模型的开发。针对金融知识匮乏人群日益增长的需求,我们分析了模型的内存占用、推理时间、与标准答案的相似度以及输出可读性,并对比零样本与少样本学习效果。结果表明,部分现成模型已具备进一步微调以服务个人用户的潜力,而另一些则存在应用局限。该研究为推动金融信息获取的民主化提供了实证基础。

原文摘要 · Abstract (English)

The use of small language models (SLMs), herein defined as models with less than three billion parameters, is increasing across various domains and applications. Due to their ability to run on more accessible hardware and preserve user privacy, SLMs possess the potential to democratize access to language models for individuals of different socioeconomic status and with different privacy preferences. This study assesses several state-of-the-art SLMs (e.g., Apple's OpenELM, Microsoft's Phi, Google's Gemma, and the Tinyllama project) for use in the financial domain to support the development of financial literacy LMs. Democratizing access to quality financial information for those who are financially under educated is greatly needed in society, particularly as new financial markets and products emerge and participation in financial markets increases due to ease of access. We are the first to examine the use of open-source SLMs to democratize access to financial question answering capabilities for individuals and students. To this end, we provide an analysis of the memory usage, inference time, similarity comparisons to ground-truth answers, and output readability of prominent SLMs to determine which models are most accessible and capable of supporting access to financial information. We analyze zero-shot and few-shot learning variants of the models. The results suggest that some off-the-shelf SLMs merit further exploration and fine-tuning to prepare them for individual use, while others may have limits to their democratization.

小模型金融素养普惠计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。