用强化学习解决天文望远镜资源调度难题,提升突发目标观测效率。
Solving Online Resource-Constrained Scheduling for Follow-Up Observation in Astronomy: a Reinforcement Learning Approach
- 构建有向无环图表征观测任务依赖关系,结合深度强化学习动态优化调度
- 在仿真环境中超越5种主流启发式算法,适应多种观测场景
- 适合需要实时资源分配的天文观测系统研发人员参考
在天文观测领域,望远镜阵列资源分配与突发目标(ToOs)的后续观测规划是科学发现的关键环节。由于在线观测设置及大量时变因素影响观测可行性,该问题计算复杂度高。本文提出ROARS,一种基于强化学习的在线天文资源约束调度方法。为捕捉观测调度结构,采用有向无环图(DAG)表示每个调度方案,刻画不同观测任务间的时序依赖关系。通过深度强化学习迭代局部重写策略,逐步优化可行解直至收敛,克服了因时空约束繁多而难以从零直接求得完整解的难题。基于真实场景构建仿真环境进行实验,结果表明,ROARS显著优于5种主流启发式算法,在多种观测场景下均能自适应并学习有效策略。
原文摘要 · Abstract (English)
In the astronomical observation field, determining the allocation of observation resources of the telescope array and planning follow-up observations for targets of opportunity (ToOs) are indispensable components of astronomical scientific discovery. This problem is computationally challenging, given the online observation setting and the abundance of time-varying factors that can affect whether an observation can be conducted. This paper presents ROARS, a reinforcement learning approach for online astronomical resource-constrained scheduling. To capture the structure of the astronomical observation scheduling, we depict every schedule using a directed acyclic graph (DAG), illustrating the dependency of timing between different observation tasks within the schedule. Deep reinforcement learning is used to learn a policy that can improve the feasible solution by iteratively local rewriting until convergence. It can solve the challenge of obtaining a complete solution directly from scratch in astronomical observation scenarios, due to the high computational complexity resulting from numerous spatial and temporal constraints. A simulation environment is developed based on real-world scenarios for experiments, to evaluate the effectiveness of our proposed scheduling approach. The experimental results show that ROARS surpasses 5 popular heuristics, adapts to various observation scenarios and learns effective strategies with hindsight.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。