arXiv:2501.00076cs.LGcs.AI2025-01

用随机神经网络建模序列,提升生成与识别的鲁棒性。

A Novel Framework for Learning Stochastic Representations for Sequence Generation and Recognition

  • 引入可学习偏置的随机递归网络,通过重参数化技巧实现概率表征。
  • 在机器人运动数据上,生成与识别准确率优于确定性模型。
  • 适合需要应对不确定性的智能系统与机器人任务。

自主系统在动态环境中需具备生成与识别序列数据的能力。受大脑预测编码与贝叶斯脑机制启发,我们提出一种带有参数化偏置的随机递归神经网络(RNNPB)。该模型利用变分自编码器中的重参数化技巧,在隐空间引入随机性,从而学习多维序列的概率表示,捕捉不确定性并增强对过拟合的鲁棒性。我们在机器人运动数据集上测试了模型在生成与识别时间模式方面的表现。实验结果表明,与确定性模型相比,该随机RNNPB在生成和识别运动序列方面均取得更优性能。结果凸显了模型在学习与推理过程中量化并调节不确定性的能力。随机性带来连续隐空间表示,促进稳定运动生成,并在识别新序列时提升泛化能力。本方法为建模时间模式提供了生物启发框架,推动人工智能与机器人系统向更稳健、自适应方向发展。

原文摘要 · Abstract (English)

The ability to generate and recognize sequential data is fundamental for autonomous systems operating in dynamic environments. Inspired by the key principles of the brain-predictive coding and the Bayesian brain-we propose a novel stochastic Recurrent Neural Network with Parametric Biases (RNNPB). The proposed model incorporates stochasticity into the latent space using the reparameterization trick used in variational autoencoders. This approach enables the model to learn probabilistic representations of multidimensional sequences, capturing uncertainty and enhancing robustness against overfitting. We tested the proposed model on a robotic motion dataset to assess its performance in generating and recognizing temporal patterns. The experimental results showed that the stochastic RNNPB model outperformed its deterministic counterpart in generating and recognizing motion sequences. The results highlighted the proposed model's capability to quantify and adjust uncertainty during both learning and inference. The stochasticity resulted in a continuous latent space representation, facilitating stable motion generation and enhanced generalization when recognizing novel sequences. Our approach provides a biologically inspired framework for modeling temporal patterns and advances the development of robust and adaptable systems in artificial intelligence and robotics.

序列生成随机建模机器人概率神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。