arXiv:2512.07437cs.LGcs.AI2025-12被引 1

用KAN网络替换强化学习模型中的神经元,提升效率与可解释性。

KAN-Dreamer: Benchmarking Kolmogorov-Arnold Networks as Function Approximators in World Models

  • 用KAN和FastKAN替代DreamerV3中的MLP与卷积层,提升参数效率。
  • 在walker_walk任务上,性能与原版MLP持平,样本效率和训练速度无损失。
  • 适合关注高效可解释模型的强化学习研究者参考。

DreamerV3是当前最先进的在线模型基于强化学习算法,以极高的样本效率著称。与此同时,科尔莫戈罗夫-阿诺德网络(KAN)作为多层感知机(MLP)的有前景替代方案,具备更优的参数效率和可解释性。为缓解KAN的计算开销,如FastKAN等变体利用径向基函数(RBF)加速推理。本文将KAN架构引入DreamerV3框架,提出KAN-Dreamer,用KAN和FastKAN层替换其特定的MLP与卷积组件。为确保在基于JAX的世界模型中高效运行,我们实现了一种定制化全向量化版本,简化网格管理。研究分为三个子系统:视觉感知、潜在预测与行为学习。在DeepMind Control Suite的walker_walk任务上,评估了样本效率、训练时间和最终性能。实验表明,将适配后的FastKAN作为奖励与继续预测器的即插即用替代品,性能与原始基于MLP的架构相当,样本效率和训练速度均保持一致。本报告为未来基于KAN的世界模型发展提供初步探索。

原文摘要 · Abstract (English)

DreamerV3 is a state-of-the-art online model-based reinforcement learning (MBRL) algorithm known for remarkable sample efficiency. Concurrently, Kolmogorov-Arnold Networks (KANs) have emerged as a promising alternative to Multi-Layer Perceptrons (MLPs), offering superior parameter efficiency and interpretability. To mitigate KANs' computational overhead, variants like FastKAN leverage Radial Basis Functions (RBFs) to accelerate inference. In this work, we investigate integrating KAN architectures into the DreamerV3 framework. We introduce KAN-Dreamer, replacing specific MLP and convolutional components of DreamerV3 with KAN and FastKAN layers. To ensure efficiency within the JAX-based World Model, we implement a tailored, fully vectorized version with simplified grid management. We structure our investigation into three subsystems: Visual Perception, Latent Prediction, and Behavior Learning. Empirical evaluations on the DeepMind Control Suite (walker_walk) analyze sample efficiency, training time, and asymptotic performance. Experimental results demonstrate that utilizing our adapted FastKAN as a drop-in replacement for the Reward and Continue predictors yields performance on par with the original MLP-based architecture, maintaining parity in both sample efficiency and training speed. This report serves as a preliminary study for future developments in KAN-based world models.

强化学习KAN网络世界模型高效建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。