让Transformer模型学会感知距离,提升3D流场预测精度。
Distance-Aware Attention and Wall-Distance Expert Routing for Transformer-Based 3D Flow Prediction

- 用壁面距离调整注意力机制,让不同位置点获取不同几何信息。
- 引入专家路由机制,近壁、过渡、自由流区域自动分组,无需人工标注。
- 在多个模型和数据集上均显著降低误差,尤其对未见车身类型泛化性强。
基于Transformer的3D流场预测模型将工业网格压缩为少量标记,每个预测点通过检索和前馈层完成计算。现有方法在两个环节均忽略点的位置信息。本文在检索和前馈层中引入壁面相关物理信号作为条件:距离感知交叉注意力(DA-CA)在检索前根据点到壁面的距离调整查询向量,使边界层内点与外流区点获取不同几何特征;表面-体积混合专家模型(SVMoE)用专家网络替代共享前馈层,体积点按壁面距离路由,表面点按局部几何路由。二者不依赖特定架构,可直接应用于AB-UPT和Transolver-3。在包含50个训练案例的DrivAerML上,DA-CA使体积压力误差降低10.1%,两者联合降低12.5%;DA-CA改善近壁区表现但牺牲远场,而SVMoE恢复了远场性能,且体积专家自发聚类为近壁、过渡、自由流三带,无需监督。在300个案例重训练后,所有场量误差均下降,AB-UPT上压力与速度误差分别降低33.1%和18.6%,Transolver-3上分别为21.4%和21.3%。在DrivAerNet++的留一车身评估中,对未见车身类型,体积压力误差最多降低14.2%。
原文摘要 · Abstract (English)
Transformer surrogates for 3D flow prediction compress an industrial mesh into a small set of tokens from which every prediction point reads. Two operations follow: the retrieval step in which a point gathers information from the compressed representation, and the feed-forward layer that transforms what it retrieved. In current backbones both are blind to where the point sits in the flow. We condition both on wall-related physical signals. Distance-aware cross-attention (DA-CA) reshapes each volume query by its wall distance before retrieval, so that a point deep in the boundary layer draws different geometric information than one in the outer flow. Surface-volume mixture-of-experts (SVMoE) replaces the shared feed-forward layer with a small set of experts, routed by wall distance for volume points and by local geometry for surface points. Neither mechanism is tied to one architecture, so we apply both unchanged to AB-UPT and Transolver-3. On DrivAerML with 50 training cases, DA-CA reduces the volume pressure error by 10.1%, and DA-CA and SVMoE together reduce it by 12.5%; DA-CA improves the near-wall region at some cost in the far region, which SVMoE recovers, and the volume experts settle into near-wall, transition, and free-stream bands without routing supervision. Retrained on 300 cases, the conditioning improves every field quantity, reducing volume pressure and velocity errors by 33.1% and 18.6% on AB-UPT and by 21.4% and 21.3% on Transolver-3. Under Leave-One-Body-Out evaluation on DrivAerNet++, it reduces the volume pressure error on unseen body types by up to 14.2%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。