用神经网络提升认知模型参数估计的抗噪能力。
Testing and Improving the Robustness of Amortized Bayesian Inference for Cognitive Models
- 训练时注入柯西分布噪声,增强神经密度估计器鲁棒性。
- 引入柯西噪声后影响函数有界,崩溃点显著提高。
- 方法简单实用,适合难以剔除异常值的领域。
认知模型的参数估计常受噪声观测和异常值影响。本文测试并改进了基于神经网络的近似贝叶斯推断(ABI)在该问题上的鲁棒性。通过玩具模型分析及对合成与真实数据的实验,采用漂移扩散模型(DDM)进行验证。首先,利用稳健统计中的经验影响函数和崩溃点评估ABI对污染物的敏感性;其次,提出在训练中引入污染分布的数据增强方法,测试多种候选分布。结果表明,在训练中加入柯西分布噪声可显著提升神经密度估计器的鲁棒性,表现为影响函数有界、崩溃点大幅提高。该方法实现简单,具备广泛适用性,尤其适用于异常值检测或清除困难的场景。
原文摘要 · Abstract (English)
Contaminant observations and outliers often cause problems when estimating the parameters of cognitive models, which are statistical models representing cognitive processes. In this study, we test and improve the robustness of parameter estimation using amortized Bayesian inference (ABI) with neural networks. To this end, we conduct systematic analyses on a toy example and analyze both synthetic and real data using a popular cognitive model, the Drift Diffusion Models (DDM). First, we study the sensitivity of ABI to contaminants with tools from robust statistics: the empirical influence function and the breakdown point. Next, we propose a data augmentation or noise injection approach that incorporates a contamination distribution into the data-generating process during training. We examine several candidate distributions and evaluate their performance and cost in terms of accuracy and efficiency loss relative to a standard estimator. Introducing contaminants from a Cauchy distribution during training considerably increases the robustness of the neural density estimator as measured by bounded influence functions and a much higher breakdown point. Overall, the proposed method is straightforward and practical to implement and has a broad applicability in fields where outlier detection or removal is challenging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。