arXiv:2410.06235cs.LG2024-10被引 1

提出神经符号方法解决模型跨域泛化难题,无需微调也能适应新场景。

Parameter Choice and Neuro-Symbolic Approaches for Deep Domain-Invariant Learning

  • 融合符号推理与深度学习,构建跨域不变特征表示
  • 在小样本下实现最优模型选择,避免梯度更新风险
  • 适用于持续变化领域,适合需要鲁棒性的实际应用

随着人工智能系统向通用人工智能发展,其需在多样化任务中表现良好、理解上下文并快速适应新场景。核心挑战在于跨相关领域泛化及对分布偏移的鲁棒性。神经符号(NeSy)AI通过连接符号与子符号范式,提升系统的可适配性、泛化能力与可解释性。本文聚焦深度域不变学习,分析常见域自适应(DA)与NeSy方法,应对连续变化领域和大域差距等现实挑战。提出适用于小样本场景的先进模型选择方法,并在无法进行梯度更新时采用非参数化域特异性调整。该工作建立了一个可扩展、通用的通用人工智能框架,展示如何利用符号推理与大语言模型构建跨域通用计算图,推动真实应用场景中的可适配智能系统发展。

原文摘要 · Abstract (English)

As artificial intelligence (AI) systems advance, we move towards broad AI: systems capable of performing well on diverse tasks, understanding context, and adapting rapidly to new scenarios. A central challenge for broad AI systems is to generalize over tasks in related domains and being robust to distribution shifts. Neuro-symbolic (NeSy) AI bridges the gap between symbolic and sub-symbolic paradigms to address these challenges, enabling adaptable, generalizable, and more interpretable systems. The development of broad AI requires advancements in domain adaptation (DA), enabling models trained on source domains to effectively generalize to unseen target domains. Traditional approaches often rely on parameter optimization and fine-tuning, which can be impractical due to high costs and risks of catastrophic forgetting. NeSy AI systems use multiple models and methods to generalize to unseen domains and maintain performance across varying conditions. We analyze common DA and NeSy approaches with a focus on deep domain-invariant learning, extending to real-world challenges such as adapting to continuously changing domains and handling large domain gaps. We showcase state-of-the-art model-selection methods for scenarios with limited samples and introduce domain-specific adaptations without gradient-based updates for cases where model tuning is infeasible. This work establishes a framework for scalable and generalizable broad AI systems applicable across various problem settings, demonstrating how symbolic reasoning and large language models can build universal computational graphs that generalize across domains and problems, contributing to more adaptable AI approaches for real-world applications.

神经符号域适应泛化能力大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。