用少量数据让汽车空气动力学模型快速适配新车型,效果比传统方法更好。
Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learning

- 用低秩适配(LoRA)在预训练模型上轻量微调,实现跨车型迁移。
- 仅用20个样本就达到决定系数R²=0.85,误差比全量微调降低50%。
- 适合缺乏大量数据的新车型开发,可替代传统大样本训练。
在工业流体仿真流程中部署科学机器学习代理模型,需在无大量数据情况下将预训练模型适配至新车型家族;然而,几何编码器所学的几何表征能否迁移到拓扑不同的形状尚无验证。本研究通过留一车型外实验,在一个6147万参数的Transformer代理模型(AB-UPT)上进行测试,该模型在四个车型家族(共411个外部气动案例)上预训练,并仅用20个样本适配第五个未见车型家族。比较了三种策略:全量微调(FFT)、轻量微调(LFT)和低秩适配(LoRA)。核心发现是:预训练几何编码器能学习可迁移的表征,但适应机制决定是否可利用。FFT因6147万自由参数在20个样本上过拟合,导致R²=0.40;LFT因冻结编码器无法表示未见形状,导致R²<0。LoRA则同时解决两者问题:在所有层注入秩约束适配器,正则化损失面并保留预训练特征,实现跨五家族均值R²=0.85±0.02,力误差降低50%,点场误差降低28%。其性能优于使用三倍目标家族数据的从零训练,无需每车型大规模数据集。结果表明,LoRA不再仅是节省内存的工具,而是几何迁移的收敛保障:共享主干+轻量适配器,可在数小时内以极小数据完成训练。
原文摘要 · Abstract (English)
Deploying Scientific Machine Learning surrogates in industrial CFD workflows requires adapting pretrained models to new vehicle families without large datasets; yet whether geometric representations learned by a geometry encoder transfer to topologically distinct shapes remains unvalidated. We address this through leave-one-family-out experiments on a 61.47M-parameter Transformer surrogate (AB-UPT) pretrained on four vehicle families (411 external aerodynamics cases) and adapted to the held-out fifth with only 20 samples. Three strategies are compared: Full Fine-Tuning (FFT), Lightweight Fine-Tuning (LFT), and Low-Rank Adaptation (LoRA). The central finding is that pretrained geometry encoders learn transferable representations, but the adaptation mechanism determines whether they can be exploited. FFT destabilizes as 61.47M unconstrained parameters overfit to 20 samples (R^2=0.40); LFT fails because the frozen encoder cannot represent unseen shapes (R^2<0). LoRA resolves both: rank-constrained adapters injected into all layers regularize the loss landscape while preserving pretrained features, achieving R^2=0.85+/-0.02 across all five families with 50% lower force RMSE than FFT and 28% lower pointwise field errors. LoRA also outperforms from-scratch training using 3x more target-family data, eliminating the need for large per-family datasets. These results recast LoRA from a memory-saving convenience into a convergence enabler for geometry transfer: a shared backbone paired with lightweight per-family adapters trainable in hours from minimal data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。