arXiv:2504.07393cs.LGmath.OC2025-04被引 2

用粒子滤波提升雷达噪声下的状态估计,让强化学习和进化算法更稳定高效。

State Estimation Using Particle Filtering in Adaptive Machine Learning Methods: Integrating Q-Learning and NEAT Algorithms with Noisy Radar Measurements

  • 将粒子滤波与Q-learning、NEAT结合,实时处理雷达噪声数据
  • 在网格导航和仿真驾驶中,训练稳定性与成功率显著优于基线方法
  • 适合需要高鲁棒性的自动驾驶状态感知场景

可靠的状态估计对复杂噪声环境中的自主系统至关重要。传统滤波方法如卡尔曼滤波在非线性动态或非高斯噪声下表现不佳,而灵活的粒子滤波在大规模场景中常面临样本退化或计算开销大的问题。同时,依赖准确状态反馈的自适应机器学习方法(如Q-learning和神经演化算法NEAT)在传感器数据不完美时会出现收敛变慢、性能下降的问题。本文提出一种融合粒子滤波与Q-learning、NEAT的统一框架,通过优化雷达观测以获得可靠状态估计,驱动更稳定的策略更新(Q-learning)或控制器演化(NEAT),从而实现更快收敛、更高回报或适应度,并增强对传感器不确定性的鲁棒性。在网格导航与模拟汽车环境中的实验表明,该方法在训练稳定性、最终性能和成功率上均显著优于缺乏先进滤波的基线方法。结果表明,准确的状态估计不仅是预处理步骤,更是提升真实世界应用中自适应学习性能的关键要素。

原文摘要 · Abstract (English)

Reliable state estimation is essential for autonomous systems operating in complex, noisy environments. Classical filtering approaches, such as the Kalman filter, can struggle when facing nonlinear dynamics or non-Gaussian noise, and even more flexible particle filters often encounter sample degeneracy or high computational costs in large-scale domains. Meanwhile, adaptive machine learning techniques, including Q-learning and neuroevolutionary algorithms such as NEAT, rely heavily on accurate state feedback to guide learning; when sensor data are imperfect, these methods suffer from degraded convergence and suboptimal performance. In this paper, we propose an integrated framework that unifies particle filtering with Q-learning and NEAT to explicitly address the challenge of noisy measurements. By refining radar-based observations into reliable state estimates, our particle filter drives more stable policy updates (in Q-learning) or controller evolution (in NEAT), allowing both reinforcement learning and neuroevolution to converge faster, achieve higher returns or fitness, and exhibit greater resilience to sensor uncertainty. Experiments on grid-based navigation and a simulated car environment highlight consistent gains in training stability, final performance, and success rates over baselines lacking advanced filtering. Altogether, these findings underscore that accurate state estimation is not merely a preprocessing step, but a vital component capable of substantially enhancing adaptive machine learning in real-world applications plagued by sensor noise.

状态估计强化学习神经演化雷达感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。