arXiv:2507.02085cs.LGcs.AI2025-07NeurIPS被引 1

轻量适配器让几何扩散模型高效可控微调

GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapters

  • 用等变适配器实现无修改微调,保持几何一致性
  • 仅微调少量参数即达顶尖性能,避免过拟合与遗忘
  • 适合分子、运动、粒子等需几何控制的生成任务

几何扩散模型在分子动力学和结构生成中表现优异,但针对下游任务进行高效微调仍缺乏探索。本文提出SE(3)等变适配器框架GeoAda,可在不修改原模型架构的前提下,灵活且参数高效地完成受控生成任务的微调。GeoAda采用结构化设计:先通过耦合算子编码控制信号,再经可训练的预训练层副本处理,最后通过解耦算子与等变零初始化卷积投影回原空间。仅微调这些轻量适配模块,即可保持模型几何一致性,缓解过拟合与灾难性遗忘。理论证明该适配器维持SE(3)等变性,确保预训练模型的几何归纳偏置在适应过程中不变。实验表明,GeoAda在多种几何控制类型(帧控制、全局控制、子图控制)及应用领域(粒子动力学、分子动力学、人体运动预测、分子生成)中均具广泛适用性,性能达到当前最优,而其他基线因过拟合和遗忘导致显著性能下降。

原文摘要 · Abstract (English)

Geometric diffusion models have shown remarkable success in molecular dynamics and structure generation. However, efficiently fine-tuning them for downstream tasks with varying geometric controls remains underexplored. In this work, we propose an SE(3)-equivariant adapter framework ( GeoAda) that enables flexible and parameter-efficient fine-tuning for controlled generative tasks without modifying the original model architecture. GeoAda introduces a structured adapter design: control signals are first encoded through coupling operators, then processed by a trainable copy of selected pretrained model layers, and finally projected back via decoupling operators followed by an equivariant zero-initialized convolution. By fine-tuning only these lightweight adapter modules, GeoAda preserves the model's geometric consistency while mitigating overfitting and catastrophic forgetting. We theoretically prove that the proposed adapters maintain SE(3)-equivariance, ensuring that the geometric inductive biases of the pretrained diffusion model remain intact during adaptation. We demonstrate the wide applicability of GeoAda across diverse geometric control types, including frame control, global control, subgraph control, and a broad range of application domains such as particle dynamics, molecular dynamics, human motion prediction, and molecule generation. Empirical results show that GeoAda achieves state-of-the-art fine-tuning performance while preserving original task accuracy, whereas other baselines experience significant performance degradation due to overfitting and catastrophic forgetting.

几何生成扩散模型微调等变网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。