arXiv:2507.10446cs.AI2025-07被引 1

用神经架构高效获取先验知识,小样本下也能快速适应新任务。

Acquiring and Adapting Priors for Novel Tasks via Neural Meta-Architectures

  • 设计超网络结构,从少量数据中学习可迁移的先验知识。
  • 在3D场景生成与分割中仅需数个样本即可实现快速适配。
  • 适用于数据稀缺领域,如分子生成与医学影像分析。

智能体将过往经验迁移到新任务的能力至关重要,这正是迁移学习的核心。尽管大模型微调在众多任务中表现优异,但在数据稀缺领域(如计算化学、计算免疫学、医学影像)难以训练大规模预训练模型。本文提出通过神经记忆机制,在非平稳分布下仅用少量样本实现有效适应;并证明超网络(生成网络的网络)在模型无关元学习(MAML)训练下能获得更泛化的先验。该方法应用于3D场景生成,仅需少数训练场景即可实现快速文本到3D生成;进一步扩展至新场景的3D分割,通过先前场景的先验高效迁移。最后,将现有分子生成方法重用于预训练,显著提升分子属性预测性能,解决计算免疫学中的关键挑战。

原文摘要 · Abstract (English)

The ability to transfer knowledge from prior experiences to novel tasks stands as a pivotal capability of intelligent agents, including both humans and computational models. This principle forms the basis of transfer learning, where large pre-trained neural networks are fine-tuned to adapt to downstream tasks. Transfer learning has demonstrated tremendous success, both in terms of task adaptation speed and performance. However there are several domains where, due to lack of data, training such large pre-trained models or foundational models is not a possibility - computational chemistry, computational immunology, and medical imaging are examples. To address these challenges, our work focuses on designing architectures to enable efficient acquisition of priors when large amounts of data are unavailable. In particular, we demonstrate that we can use neural memory to enable adaptation on non-stationary distributions with only a few samples. Then we demonstrate that our hypernetwork designs (a network that generates another network) can acquire more generalizable priors than standard networks when trained with Model Agnostic Meta-Learning (MAML). Subsequently, we apply hypernetworks to 3D scene generation, demonstrating that they can acquire priors efficiently on just a handful of training scenes, thereby leading to faster text-to-3D generation. We then extend our hypernetwork framework to perform 3D segmentation on novel scenes with limited data by efficiently transferring priors from earlier viewed scenes. Finally, we repurpose an existing molecular generative method as a pre-training framework that facilitates improved molecular property prediction, addressing critical challenges in computational immunology.

元学习超网络小样本3D生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。