对比PPO与DQN在作物管理中的表现,发现不同任务下各有优劣。
A Comparative Study of Deep Reinforcement Learning for Crop Production Management
- 在相同环境下对比PPO与DQN的决策性能。
- PPO在施肥和灌溉任务中表现更优,DQN在综合管理中领先。
- 为智能农业策略设计提供实证依据,适合农业AI研究者参考。
作物生产管理对优化产量并减少环境影响至关重要,但其复杂性和随机性带来挑战。近年来,强化学习(RL)因其在动态环境中通过试错学习最优决策的能力,成为发展自适应作物管理策略的有力工具。本研究在gym-DSSAT作物模拟器环境中,系统比较了近端策略优化(PPO)与深度Q网络(DQN)在三种任务——施肥、灌溉及混合管理——中的表现。采用统一参数、相同奖励函数与环境设置以确保公平对比。结果表明,PPO在施肥与灌溉任务中优于DQN,而DQN在混合管理任务中表现更佳。该分析揭示了两种方法的优劣势,有助于推动更高效的基于强化学习的作物管理策略发展。
原文摘要 · Abstract (English)
Crop production management is essential for optimizing yield and minimizing a field's environmental impact to crop fields, yet it remains challenging due to the complex and stochastic processes involved. Recently, researchers have turned to machine learning to address these complexities. Specifically, reinforcement learning (RL), a cutting-edge approach designed to learn optimal decision-making strategies through trial and error in dynamic environments, has emerged as a promising tool for developing adaptive crop management policies. RL models aim to optimize long-term rewards by continuously interacting with the environment, making them well-suited for tackling the uncertainties and variability inherent in crop management. Studies have shown that RL can generate crop management policies that compete with, and even outperform, expert-designed policies within simulation-based crop models. In the gym-DSSAT crop model environment, one of the most widely used simulators for crop management, proximal policy optimization (PPO) and deep Q-networks (DQN) have shown promising results. However, these methods have not yet been systematically evaluated under identical conditions. In this study, we evaluated PPO and DQN against static baseline policies across three different RL tasks, fertilization, irrigation, and mixed management, provided by the gym-DSSAT environment. To ensure a fair comparison, we used consistent default parameters, identical reward functions, and the same environment settings. Our results indicate that PPO outperforms DQN in fertilization and irrigation tasks, while DQN excels in the mixed management task. This comparative analysis provides critical insights into the strengths and limitations of each approach, advancing the development of more effective RL-based crop management strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。