用系统化方法提升大模型预测比特币价格,效果优于专用模型。
PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting

- 结合低秩微调与递归推理等五种技术优化大模型
- 在验证集和测试集上误差最低,且跨周期表现稳定
- 适合对金融时序预测感兴趣的开发者或研究者
加密货币市场波动剧烈且非平稳,传统预测方法面临挑战。尽管大语言模型(LLMs)在时间序列预测中展现潜力,但其适配策略的综合影响在金融场景中仍不明确。本研究提出PRICE,一种针对短期比特币价格预测的系统性大模型适配方法。基于4比特量化后的LLaMA-3 8B模型,PRICE研究微调、数值表示、提示方式、推理与解码策略的协同作用。方法融合参数高效微调(LoRA)、递归多步推理、整数取整数值表示、上下文-任务-格式(CTF)提示及零温度解码。消融实验表明各组件均提升准确性和可靠性:LoRA实现低资源高效训练,递归推理提高精度,整数取整减少误差,CTF提示优于思维链、隐式思维链及少样本提示,零温度解码增强递归预测稳定性。与八种基于Transformer和时序基础模型对比,PRICE在验证集和测试集均取得最低误差,且在不同评估周期保持鲁棒性能。尽管模型预训练以文本为主而非时序数据,其表现仍可媲美甚至超越专用基础模型。结果表明,适配策略显著影响大模型在数值时序预测中的准确性与鲁棒性。
原文摘要 · Abstract (English)
Cryptocurrency markets exhibit extreme volatility and non-stationary dynamics that challenge conventional forecasting methods. Although Large Language Models (LLMs) have shown promise for time series forecasting, the combined effects of adaptation choices remain largely unexplored in financial settings. This study introduces PRICE, a structured approach for adapting LLMs to short-term Bitcoin price forecasting. Built on a 4-bit quantized LLaMA-3 8B model, PRICE investigates how fine-tuning, numerical representation, prompting, inference, and decoding jointly influence forecasting performance. PRICE integrates Parameter-efficient fine-tuning with Low-Rank Adaptation (LoRA), Recursive multi-step inference, Integer-rounded numerical representation, Context-Task-Format (CTF) prompting, and Exact zero-temperature decoding. Ablation studies show that each component contributes to forecasting accuracy and reliability. LoRA enables efficient training on limited hardware, recursive inference improves accuracy, integer-rounded values reduce errors, CTF prompting outperforms Chain-of-Thought, Implicit Chain-of-Thought (iCoT), and few-shot prompting, and zero-temperature decoding improves stability during recursive forecasting. Comparative evaluation against eight transformer-based and time-series foundation models shows that PRICE achieves the lowest forecasting errors on both validation and test sets while maintaining robust performance across evaluation periods. Despite being based on a model primarily pretrained on text rather than time-series data, PRICE achieves competitive or superior performance relative to specialized foundation models. These findings demonstrate that adaptation choices critically determine the accuracy and robustness of LLMs for numerical time-series forecasting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。