arXiv:2510.24010cs.CVcs.AI2025-10NeurIPS被引 5

首个面向火星科学任务的基准测试,助力模型评估与改进。

Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Tasks

  • 构建20个火星任务数据集,覆盖轨道与表面影像
  • 验证火星专用模型优于通用模型,凸显领域适配优势
  • 适合行星科学、遥感与AI交叉研究者使用

基础模型通过大规模无标签数据预训练,在多个专业领域实现快速进展,展现出强大的下游任务泛化能力。尽管在地球观测等领域已取得显著成果,其在火星科学中的应用仍有限。领域进展的关键驱动力之一是标准化基准的可用性,而当前火星科学缺乏此类基准与评估框架,制约了针对火星任务的基础模型发展。为此,我们提出Mars-Bench,首个系统评估多种火星相关任务的基准,涵盖轨道与表面影像。该基准包含20个数据集,涉及分类、分割和目标检测,聚焦撞击坑、火山锥、岩石块和霜冻等关键地质特征。我们提供标准化数据集及基线评估,采用在自然图像、地球卫星数据和先进视觉-语言模型上预训练的模型进行测试。所有分析结果表明,火星专用基础模型相比通用模型更具优势,支持进一步开展领域适配的预训练探索。Mars-Bench旨在为火星科学机器学习模型的开发与比较建立标准化基础。数据、模型与代码已公开:https://mars-bench.github.io/。

原文摘要 · Abstract (English)

Foundation models have enabled rapid progress across many specialized domains by leveraging large-scale pre-training on unlabeled data, demonstrating strong generalization to a variety of downstream tasks. While such models have gained significant attention in fields like Earth Observation, their application to Mars science remains limited. A key enabler of progress in other domains has been the availability of standardized benchmarks that support systematic evaluation. In contrast, Mars science lacks such benchmarks and standardized evaluation frameworks, which have limited progress toward developing foundation models for Martian tasks. To address this gap, we introduce Mars-Bench, the first benchmark designed to systematically evaluate models across a broad range of Mars-related tasks using both orbital and surface imagery. Mars-Bench comprises 20 datasets spanning classification, segmentation, and object detection, focused on key geologic features such as craters, cones, boulders, and frost. We provide standardized, ready-to-use datasets and baseline evaluations using models pre-trained on natural images, Earth satellite data, and state-of-the-art vision-language models. Results from all analyses suggest that Mars-specific foundation models may offer advantages over general-domain counterparts, motivating further exploration of domain-adapted pre-training. Mars-Bench aims to establish a standardized foundation for developing and comparing machine learning models for Mars science. Our data, models, and code are available at: https://mars-bench.github.io/.

火星科学基准测试遥感基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。