用深度强化学习优化内存均衡器参数,提升信号质量。
Deep Reinforcement Learning-Based DRAM Equalizer Parameter Optimization Using Latent Representations
- 用学习的潜在表征替代传统眼图分析,加速信号完整性评估。
- 在多种内存结构上实现42.7%和36.8%的眼图开窗面积提升。
- 无需系统模型,适用于复杂均衡器架构,适合芯片设计工程师。
高速动态随机存取存储器(DRAM)中的均衡器参数优化对信号完整性至关重要,但传统方法计算成本高或依赖模型。本文提出一种数据驱动框架,利用学习的潜在信号表征实现高效信号完整性评估,并结合无模型优势演员-评论家强化学习算法进行参数优化。潜在表征捕捉关键信号完整性特征,可快速替代直接眼图分析;强化学习代理在无需显式系统模型的情况下获得最优均衡器设置。该方法应用于行业标准的DRAM波形,在级联连续时间线性均衡器与决策反馈均衡器结构中实现42.7%的眼图开窗面积提升,在仅决策反馈均衡器配置下实现36.8%的提升。结果表明,该方法在性能、计算效率和跨DRAM单元泛化能力方面均优于现有技术。核心贡献包括高效的潜在信号完整性度量、鲁棒的无模型强化学习策略,以及对复杂均衡器架构的验证性能。
原文摘要 · Abstract (English)
Equalizer parameter optimization for signal integrity in high-speed Dynamic Random Access Memory systems is crucial but often computationally demanding or model-reliant. This paper introduces a data-driven framework employing learned latent signal representations for efficient signal integrity evaluation, coupled with a model-free Advantage Actor-Critic reinforcement learning agent for parameter optimization. The latent representation captures vital signal integrity features, offering a fast alternative to direct eye diagram analysis during optimization, while the reinforcement learning agent derives optimal equalizer settings without explicit system models. Applied to industry-standard Dynamic Random Access Memory waveforms, the method achieved significant eye-opening window area improvements: 42.7\% for cascaded Continuous-Time Linear Equalizer and Decision Feedback Equalizer structures, and 36.8\% for Decision Feedback Equalizer-only configurations. These results demonstrate superior performance, computational efficiency, and robust generalization across diverse Dynamic Random Access Memory units compared to existing techniques. Core contributions include an efficient latent signal integrity metric for optimization, a robust model-free reinforcement learning strategy, and validated superior performance for complex equalizer architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。