arXiv:2411.03740cs.LGcs.HC2024-11

用可解释的KAN-DDQN实现动态自适应特征选择,兼顾性能与透明度。

Human-in-the-Loop Feature Selection Using Interpretable Kolmogorov-Arnold Network-based Double Deep Q-Network

  • 基于KAN与双深度Q网络,结合人类反馈迭代优化每条数据的特征子集。
  • 在MNIST上达93%准确率,比传统模型高9%,且隐藏层神经元少4倍。
  • 适合需实时决策、低人工干预的场景,模型透明度高,延迟低于1毫秒。

特征选择对提升机器学习模型性能和可解释性至关重要,尤其在高维空间中,复杂特征交互会降低准确率并增加计算负担。现有方法多依赖静态特征子集或人工干预,难以适应变化且扩展性差。本文提出一种融入人类反馈的动态特征选择框架,基于柯尔莫戈洛夫-阿诺德网络(KAN)的双深度Q网络(DDQN),通过模拟人类反馈和贝塔分布采样,逐样本迭代优化特征子集。该框架在MNIST上测试准确率达93%,在FashionMNIST上达83%,较传统MLP-DDQN提升最高达9%。其采用符号化表达实现高可解释性,隐藏层神经元数量仅为MLP的1/4。未使用特征选择的模型仅达58%(MNIST)和64%(FashionMNIST)。在CIFAR-10和CIFAR-100上验证了可扩展性,相对宏F1提升最高达30%(MNIST)和5%(CIFAR-10),校准误差降低25%。复杂度分析表明,系统延迟低于1毫秒,参数量低于0.02M,支持实时部署。剪枝与可视化进一步揭示决策路径。结果表明,该方法为需实时自适应决策的应用提供了可扩展、可解释的解决方案。

原文摘要 · Abstract (English)

Feature selection is critical for improving the performance and interpretability of machine learning models, particularly in high-dimensional spaces where complex feature interactions can reduce accuracy and increase computational demands. Existing approaches often rely on static feature subsets or manual intervention, limiting adaptability and scalability. However, dynamic, per-instance feature selection methods and model-specific interpretability in reinforcement learning remain underexplored. This study proposes a human-in-the-loop (HITL) feature selection framework integrated into a Double Deep Q-Network (DDQN) using a Kolmogorov-Arnold Network (KAN). Our novel approach leverages simulated human feedback and stochastic distribution-based sampling, specifically Beta, to iteratively refine feature subsets per data instance, improving flexibility in feature selection. The KAN-DDQN achieved notable test accuracies of 93% on MNIST and 83% on FashionMNIST, outperforming conventional MLP-DDQN models by up to 9%. The KAN-based model provided high interpretability via symbolic representation while using 4 times fewer neurons in the hidden layer than MLPs did. Comparatively, the models without feature selection achieved test accuracies of only 58% on MNIST and 64% on FashionMNIST, highlighting significant gains with our framework. We further validate scalability on CIFAR-10 and CIFAR-100, achieving up to 30% relative macro F1 improvement on MNIST and 5% on CIFAR-10, while reducing calibration error by 25%. Complexity analysis confirms real-time feasibility with latency below 1 ms and parameter counts under 0.02M. Pruning and visualization further enhanced model transparency by elucidating decision pathways. These findings present a scalable, interpretable solution for feature selection that is suitable for applications requiring real-time, adaptive decision-making with minimal human oversight.

特征选择可解释性强化学习实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。