arXiv:2506.04243cs.LGcs.AI2025-06

用三重注意力机制预测混凝土蠕变,精度达99.9%。

Triple Attention Transformer Architecture for Time-Dependent Concrete Creep Prediction

  • 将蠕变建模为自回归序列,用三重注意力捕捉时间与材料关系。
  • 160天数据上误差仅1.63%,R²达0.999,显著优于传统方法。
  • 模型可解释性强,适合工程应用,且有在线接口可用。

本文提出一种用于预测时变混凝土蠕变的新型三重注意力Transformer架构,解决了现有方法将时间仅作为输入参数而忽略变形发展序列性的根本缺陷。通过将蠕变预测转化为类似语言处理的自回归序列建模任务,该架构利用Transformer的自注意力机制捕捉历史蠕变模式中的长程依赖。模型采用三流注意力框架,包含用于序列演进的时序注意力、用于材料属性交互的特征注意力,以及用于样本间关系的批量注意力。在涵盖160天标准化日测量值的实验数据集上评估,模型取得均方百分比误差1.63%、所有数据集R²达0.999的优异性能,显著优于传统经验模型和现有机器学习方法。消融实验证实注意力机制的关键作用,其中注意力池化对性能提升贡献最大。SHAP分析显示,弹性模量是主要预测特征,其次为密度和抗压强度,为工程应用提供必要可解释性。部署的基于Web的界面支持使用标准实验室参数进行实时预测。本工作验证了Transformer架构在材料科学问题中的可行性,展示了数据驱动方法在结构行为预测与工程设计中的革新潜力。

原文摘要 · Abstract (English)

This paper presents a novel Triple Attention Transformer Architecture for predicting time-dependent concrete creep, addressing fundamental limitations in current approaches that treat time as merely an input parameter rather than modeling the sequential nature of deformation development. By transforming concrete creep prediction into an autoregressive sequence modeling task similar to language processing, our architecture leverages the transformer's self-attention mechanisms to capture long-range dependencies in historical creep patterns. The model implements a triple-stream attention framework incorporating temporal attention for sequential progression, feature attention for material property interactions, and batch attention for inter-sample relationships. Evaluated on experimental datasets with standardized daily measurements spanning 160 days, the architecture achieves exceptional performance with mean absolute percentage error of 1.63% and R2 values of 0.999 across all datasets, substantially outperforming traditional empirical models and existing machine learning approaches. Ablation studies confirm the critical role of attention mechanisms, with attention pooling contributing most significantly to model performance. SHAP analysis reveals Young's modulus as the primary predictive feature, followed by density and compressive strength, providing interpretability essential for engineering applications. A deployed web-based interface facilitates practical implementation, enabling real-time predictions using standard laboratory parameters. This work establishes the viability of applying transformer architectures to materials science problems, demonstrating the potential for data-driven approaches to revolutionize structural behavior prediction and engineering design practices.

混凝土时间序列Transformer预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。