用无服务器云计算实现天文图像高效推理,12.6GB数据28秒完成。
Scalable Cosmic AI Inference using Cloud Serverless Computing
- 结合预训练模型与无服务器架构,实现弹性扩展推理。
- 12.6GB数据仅需28秒,吞吐达18.04亿比特/秒,成本低于5美元。
- 适合需要低成本高可扩展性的天文学家和科研团队。
大规模天文图像处理与预测对天文学研究至关重要,有助于理解天体、宇宙历史及演化。尽管现代深度学习模型具备高预测精度,但通常需要大量计算资源,限制了其可访问性。本文提出基于云的天体推理(CAI)框架,通过函数即服务(FaaS)将预训练基础模型与无服务器云基础设施集成。该方案无需专用硬件即可实现高效可扩展的推理。以红移预测为例,实验覆盖用户设备、高性能计算(HPC)服务器与云端。使用AstroMAE模型进行红移预测,处理12.6 GB数据仅需28秒,远优于HPC GPU的140.8秒与HPC CPU的1793秒。系统达到18.04亿比特/秒的吞吐率,且推理时间随数据量增加保持稳定,单次实验成本低于5美元。此外,成功处理高达1TB的超大规模数据,验证了其在真实场景中的有效性。该框架为天文学界提供了一种高度可扩展、可访问且成本低廉的推理解决方案。代码已开源:https://github.com/UVA-MLSys/AI-for-Astronomy。
原文摘要 · Abstract (English)
Large-scale astronomical image data processing and prediction are essential for astronomers, providing crucial insights into celestial objects, the universe's history, and its evolution. While modern deep learning models offer high predictive accuracy, they often demand substantial computational resources, making them resource-intensive and limiting accessibility. We introduce the Cloud-based Astronomy Inference (CAI) framework to address these challenges. This scalable solution integrates pre-trained foundation models with serverless cloud infrastructure through a Function-as-a-Service (FaaS). CAI enables efficient and scalable inference on astronomical images without extensive hardware. Using a foundation model for redshift prediction as a case study, our extensive experiments cover user devices, HPC (High-Performance Computing) servers, and Cloud. Using redshift prediction with the AstroMAE model demonstrated CAI's scalability and efficiency, achieving inference on a 12.6 GB dataset in only 28 seconds compared to 140.8 seconds on HPC GPUs and 1793 seconds on HPC CPUs. CAI also achieved significantly higher throughput, reaching 18.04 billion bits per second (bps), and maintained near-constant inference times as data sizes increased, all at minimal computational cost (under $5 per experiment). We also process large-scale data up to 1 TB to show CAI's effectiveness at scale. CAI thus provides a highly scalable, accessible, and cost-effective inference solution for the astronomy community. The code is accessible at https://github.com/UVA-MLSys/AI-for-Astronomy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。