arXiv:2508.02247q-fin.CPcs.AI2025-08被引 3

直接在字节流上生成订单簿事件,避免传统方法的离散化偏差。

ByteGen: A Tokenizer-Free Generative Model for Orderbook Events in Byte Space

  • 跳过分词和特征工程,用字节级自回归模型直接处理原始数据。
  • 在3400万条CME比特币期货数据上复现了价格分布、厚尾收益等市场特性。
  • 适合对高频金融建模有要求的研究者或量化团队使用。

高频限价订单簿(LOB)动态的生成建模是量化金融中的关键挑战,对稳健的市场模拟与策略回测至关重要。现有方法常受简化随机假设限制,或依赖Transformer等深度学习模型的分词方案,导致金融数据的高精度数值特性因离散化和分箱而受损。为此,我们提出ByteGen,一种直接在订单簿事件原始字节流上运行的新型生成模型。该方法将问题视为自回归的下一字节预测任务,并设计了一种紧凑高效的32字节打包二进制格式,在无信息损失前提下表示市场消息。核心创新在于完全消除特征工程与分词,使模型从最基础的数据表示中学习市场动态。通过适配混合Mamba-Transformer架构的H-Net,利用动态分块机制发现消息内在结构,无需预设规则。主要贡献包括:1)首个端到端的字节级订单簿建模框架;2)高效的打包数据表示;3)在高频数据上的全面评估。在超过3400万条来自CME比特币期货的数据上训练后,ByteGen成功生成了真实的价格分布、重尾收益及突发性事件时间模式。结果表明,直接在字节空间学习是一种极具前景且高度灵活的复杂金融系统建模范式,在标准市场质量指标上表现优异,且无分词带来的偏差。

原文摘要 · Abstract (English)

Generative modeling of high-frequency limit order book (LOB) dynamics is a critical yet unsolved challenge in quantitative finance, essential for robust market simulation and strategy backtesting. Existing approaches are often constrained by simplifying stochastic assumptions or, in the case of modern deep learning models like Transformers, rely on tokenization schemes that affect the high-precision, numerical nature of financial data through discretization and binning. To address these limitations, we introduce ByteGen, a novel generative model that operates directly on the raw byte streams of LOB events. Our approach treats the problem as an autoregressive next-byte prediction task, for which we design a compact and efficient 32-byte packed binary format to represent market messages without information loss. The core novelty of our work is the complete elimination of feature engineering and tokenization, enabling the model to learn market dynamics from its most fundamental representation. We achieve this by adapting the H-Net architecture, a hybrid Mamba-Transformer model that uses a dynamic chunking mechanism to discover the inherent structure of market messages without predefined rules. Our primary contributions are: 1) the first end-to-end, byte-level framework for LOB modeling; 2) an efficient packed data representation; and 3) a comprehensive evaluation on high-frequency data. Trained on over 34 million events from CME Bitcoin futures, ByteGen successfully reproduces key stylized facts of financial markets, generating realistic price distributions, heavy-tailed returns, and bursty event timing. Our findings demonstrate that learning directly from byte space is a promising and highly flexible paradigm for modeling complex financial systems, achieving competitive performance on standard market quality metrics without the biases of tokenization.

金融建模字节空间生成模型高频交易

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。