受神经科学启发,构建可跨领域进化的时空模型,提升知识迁移能力。
SynEVO: A neuro-inspired spatiotemporal evolutional framework for cross-domain adaptation

- 模仿人类学习路径,分阶段整合数据,实现模型持续进化
- 跨域场景下泛化能力最高提升42%,显著优于独立训练模型
- 适合需要持续学习与跨任务迁移的智能系统研发者
从时空系统中发现规律有助于各类科学与社会规划。现有时空学习方法通常为特定源数据训练独立模型,导致跨源迁移能力有限,即使相关任务也需重新设计与训练。提升跨域知识共享的关键在于实现集体智能与模型演化。本文受神经科学理论启发,理论上推导出通过学习跨域集体智能可提升信息边界,并提出一种突触进化式时空网络 SynEVO。SynEVO 打破模型独立性,实现跨域知识的共享与聚合。具体而言,先对样本组进行重排序以模拟人类课程学习,设计两个互补模块:弹性共用容器与任务无关提取器,实现模型成长与任务间共性与个性解耦;再引入自适应动态耦合器及新差异度量,判断新样本组是否应纳入共用容器,从而在多域环境下实现模型演化。实验表明,SynEVO 在跨域场景下泛化能力最高提升42%,为神经形态人工智能中的知识迁移与适应提供新范式。
原文摘要 · Abstract (English)
Discovering regularities from spatiotemporal systems can benefit various scientific and social planning. Current spatiotemporal learners usually train an independent model from a specific source data that leads to limited transferability among sources, where even correlated tasks requires new design and training. The key towards increasing cross-domain knowledge is to enable collective intelligence and model evolution. In this paper, inspired by neuroscience theories, we theoretically derive the increased information boundary via learning cross-domain collective intelligence and propose a Synaptic EVOlutional spatiotemporal network, SynEVO, where SynEVO breaks the model independence and enables cross-domain knowledge to be shared and aggregated. Specifically, we first re-order the sample groups to imitate the human curriculum learning, and devise two complementary learners, elastic common container and task-independent extractor to allow model growth and task-wise commonality and personality disentanglement. Then an adaptive dynamic coupler with a new difference metric determines whether the new sample group should be incorporated into common container to achieve model evolution under various domains. Experiments show that SynEVO improves the generalization capacity by at most 42% under cross-domain scenarios and SynEVO provides a paradigm of NeuroAI for knowledge transfer and adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。