arXiv:2508.05210cs.LGcs.AI2025-08被引 5

融合LSTM、Transformer与时间序列混洗器,精准预测钻进速率

Advanced Hybrid Transformer LSTM Technique with Attention and TS Mixer for Drilling Rate of Penetration Prediction

  • 分步处理时序与静态特征,捕捉多尺度钻井动态
  • 在真实数据上实现0.9991的决定系数和1.447%的平均绝对误差
  • 适合油气勘探中需要高精度钻井预测的工程师和算法团队

钻进速率(ROP)预测对钻井优化至关重要,但受钻井数据非线性、动态性和异质性影响,仍具挑战。传统经验模型、物理模型及标准机器学习方法依赖过度简化的假设或繁琐特征工程,难以建模长期依赖和复杂特征交互。本文提出一种新型深度学习混合框架LSTM-Trans-Mixer-Att:首先用定制LSTM网络捕捉与钻井周期对齐的多尺度时序依赖;随后,采用含钻井特异性位置编码和实时优化的增强型Transformer编码器细化特征;同时引入并行时间序列混洗器(TS-Mixer)块,高效建模静态与类别参数(如岩性指数、泥浆性质)间的交叉交互;来自增强Transformer与TS-Mixer的特征表示通过专用融合层整合;最后,自适应注意力机制动态分配上下文权重,提升判别性表征能力,实现高保真ROP预测。该框架综合了序列记忆、静态特征交互、全局上下文学习与动态加权,全面应对钻井动态的异质性与事件驱动特性。在真实钻井数据集上的实验验证表明,其性能显著优于现有基线与混合模型,达到决定系数0.9991,平均绝对百分比误差1.447%。

原文摘要 · Abstract (English)

Rate of Penetration (ROP) prediction is critical for drilling optimization yet remains challenging due to the nonlinear, dynamic, and heterogeneous characteristics of drilling data. Conventional empirical, physics-based, and standard machine learning models rely on oversimplified assumptions or intensive feature engineering, constraining their capacity to model long-term dependencies and intricate feature interactions. To address these issues, this study presents a new deep learning Hybrid LSTM-Trans-Mixer-Att framework that first processes input data through a customized Long Short-Term Memory (LSTM) network to capture multi-scale temporal dependencies aligned with drilling cycles. Subsequently, an Enhanced Transformer encoder with drilling-specific positional encodings and real-time optimization refines the features. Concurrently, a parallel Time-Series Mixer (TS-Mixer) block introduced facilitates efficient cross-feature interaction modeling of static and categorical parameters, including lithological indices and mud properties. The feature representations extracted from the Enhanced Transformer and TS-Mixer modules are integrated through a dedicated fusion layer. Finally, an adaptive attention mechanism then dynamically assigns contextual weights to salient features, enhancing discriminative representation learning and enabling high-fidelity ROP prediction. The proposed framework combines sequential memory, static feature interactions, global context learning, and dynamic feature weighting, providing a comprehensive solution for the heterogeneous and event-driven nature of drilling dynamics. Experimental validation on real-world drilling datasets demonstrates superior performance, achieving an Rsquare of 0.9991 and a MAPE of 1.447%, significantly outperforming existing baseline and hybrid models.

ROP预测深度学习钻井优化混合模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。