用低秩更新实现物理约束图网络的高效域适应,显著降低参数量。
Parameter-Efficient Domain Adaptation of Physics-Informed Self-Attention based GNNs for AC Power Flow Prediction
- 对注意力层应用低秩适配,仅更新少量参数以适应新电网。
- 在高压电网上达到接近全微调的精度,参数量减少85.46%。
- 适合需快速部署且保持物理一致性的电力系统预测场景。
当在中压(MV)电网上训练的模型部署到高压(HV)电网时,准确预测交流潮流(AC-PF)面临域偏移挑战。现有物理信息图神经网络通常依赖全微调进行跨区域迁移,导致重训练成本高,且难以控制稳定性与可塑性权衡。本文研究基于自注意力的物理信息图网络的参数高效域适应,通过物理损失鼓励基尔霍夫一致性,同时限制适应为低秩更新。具体采用低秩适配(LoRA)作用于注意力投影,并选择性解冻预测头以调节适应能力。该设计在电压体制变化下实现了可控的效率-精度权衡。在多个电网拓扑上,所提方法在目标域的均方根误差差距仅为 $2.6 \times 10^{-4}$,相比全微调,参数量减少 $85.46\\$;物理残差与全微调相当,但源域保留率下降4.7个百分点(17.9% vs. 22.6%),仍实现参数高效且物理一致的交流潮流估计。
原文摘要 · Abstract (English)
Accurate AC power flow (AC-PF) prediction under domain shift is critical when models trained on medium-voltage (MV) grids are deployed on high-voltage (HV) networks. Existing physics-informed graph neural network (GNN) solvers typically rely on full fine-tuning for cross-regime transfer, incurring high retraining cost and offering limited control over the stability-plasticity trade-off between target-domain adaptation and source-domain retention. We study parameter-efficient domain adaptation for physics-informed self-attention-based GNNs, encouraging Kirchhoff-consistent behavior via a physics-based loss while restricting adaptation to low-rank updates. Specifically, we apply low-rank adaptation (LoRA) to attention projections with selective unfreezing of the prediction head to regulate adaptation capacity. This design yields a controllable efficiency-accuracy trade-off for physics-constrained inverse estimation under voltage-regime shift. Across multiple grid topologies, the proposed LoRA+PHead adaptation recovers near-full fine-tuning accuracy with a target-domain RMSE gap of $2.6 \times 10^{-4}$ while reducing the number of trainable parameters by $85.46\%$. The physics-based residual remains comparable to full fine-tuning; however, relative to Full FT, LoRA+PHead reduces MV source retention by 4.7 percentage points (17.9% vs. 22.6%) under domain shift, while still enabling parameter-efficient and physically consistent AC-PF estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。