用多模态数据和层级标签结构,自动识别土壤层的精确位置与类型。
SoilNet: A Multimodal Multitask Model for Hierarchical Classification of Soil Horizons
- 分三步:先定位土层深度,再提取形态特征,最后融合多源信息预测标签。
- 在真实数据集上准确率超过人类专家,对复杂层级标签识别效果优异。
- 适合土壤科学、环境监测领域的研究人员,尤其关注自动化土壤分析者。
人工智能,特别是基础模型的进步,已推动多个领域(包括地球科学)的前沿发展。然而,某些具体问题仍未受益于这一进展。例如,土壤层分类因具有多模态、多任务特性以及复杂的分层标签体系而仍具挑战性。准确的土壤层分类对于监测土壤状况至关重要。本文提出 extit{SoilNet}——一种面向分层分类的多模态多任务模型,通过结构化模块化流程解决该问题。与通用基础模型不同,本方法遵循人类专家构建的任务结构,具备内在可解释性。模型整合图像数据与地理时空元数据,首先预测深度标记,将土剖面分割为候选土层;每个片段通过一组特定于土层的形态特征表征;最终基于多模态拼接特征向量预测土层标签,并利用图结构标签表示处理土层间复杂的层级关系。本方法专为高数量、不平衡且非平凡结构的分层分类设计。我们在真实世界土剖面数据集和包含领域专家的综合用户研究中验证了其有效性。实证评估表明,SoilNet 能可靠预测合理且准确的土层。用户研究结果显示,其预测性能达到或优于人类专家水平。所有代码均可在 https://github.com/calgo-lab/BGR/ 获取。
原文摘要 · Abstract (English)
Recent advances in artificial intelligence (AI), in particular foundation models, have improved the state of the art in many application domains including geosciences. Some specific problems, however, could not benefit from this progress yet. Soil horizon classification, for instance, remains challenging because of its multimodal and multitask characteristics and a complex hierarchically structured label taxonomy. Accurate classification of soil horizons is crucial for monitoring soil condition. In this work, we propose \textit{SoilNet} - a multimodal multitask model to tackle this problem through a structured modularized pipeline. In contrast to omnipurpose AI foundation models, our approach is designed to be inherently transparent by following the task structure human experts developed for solving this challenging annotation task. The proposed approach integrates image data and geotemporal metadata to first predict depth markers, segmenting the soil profile into horizon candidates. Each segment is characterized by a set of horizon-specific morphological features. Finally, horizon labels are predicted based on the multimodal concatenated feature vector, leveraging a graph-based label representation to account for the complex hierarchical relationships among soil horizons. Our method is designed to address complex hierarchical classification, where the number of possible labels is very large, imbalanced and non-trivially structured. We demonstrate the effectiveness of our approach on a real-world soil profile dataset and a comprehensive user study with domain experts. Our empirical evaluations demonstrate that SoilNet reliably predicts soil horizons that are plausible and accurate. User study results indicate that SoilNet achieves predictive performance on par with or better than that of human experts. All code can be found at: https://github.com/calgo-lab/BGR/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。