让文保专家无需编程也能用计算机视觉分析文物
AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage

- 提供图形界面实现数据管理、模型训练与推理全流程
- 支持分割与分类模型,结合Grad-CAM和VLM增强可解释性
- 可本地部署,适合敏感文物数据的机构内使用
计算机视觉与机器学习为文化遗产分析提供了新工具,但现有模型构建流程对非专业人员仍不友好。本文提出AmalthAI,一个开源视觉平台,使无机器学习背景的文化遗产专家能独立完成有意义的分析。平台覆盖数据管理、模型训练与推理,支持分类、分割和目标检测任务,利用Kubeflow与Katib实现可扩展训练与超参搜索。通过Grad-CAM定位预测依据区域,并结合视觉语言模型生成文本描述供专家评审。针对考古数据常受权属限制、无法外传的情况,平台支持自托管部署,确保数据不出机构。我们在自建的陶质纺织品印痕数据集上测试,文保专家成功训练并验证了分割与分类模型,用于假设检验。代码已开源:https://github.com/TEXTaiLES/AmalthAI。
原文摘要 · Abstract (English)
Computer vision (CV) and machine learning (ML) offer new tools for cultural heritage (CH) artifact analysis, but the CV/ML pipeline remains largely inaccessible to CH domain experts, who lack the background to configure, train, or assess models. We present AmalthAI, an open-source CV platform that bridges this gap, enabling non-ML CH experts to independently produce and validate archaeologically meaningful findings. The interface covers dataset management, training, and inference for classification, segmentation, and object detection, with Kubeflow and Katib handling scalable training and hyperparameter search. Grad-CAM localizes the image region behind a prediction, and a vision-language model (VLM) adds a text description of it for expert review. Since archaeological data is often state-owned or rights-encumbered and cannot leave institutional custody, AmalthAI's self-hostable deployment ensures sensitive data is kept within premises. We test the platform on an archaeological use case built on a custom dataset of clay textile imprints, where CH experts trained and validated segmentation, and classification models for hypothesis testing. We provide the implementation code at https://github.com/TEXTaiLES/AmalthAI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。