构建青铜器细粒度年代分类基准数据集,揭示通用异常检测方法在专业领域失效问题。
ShiftedBronzes: Benchmarking and Analysis of Domain Fine-Grained Classification in Open-World Settings
- 构建含两类青铜器、七类分布偏移数据的细分领域基准数据集
- 发现通用异常检测方法在青铜器年代任务中性能显著下降
- 适合古文物分析与领域自适应研究者参考
在多个专业领域的实际应用中,处理复杂的分布外(OOD)挑战是一项常见且关键的问题。本研究聚焦于中国古代青铜器细粒度年代判定这一重要课题,构建了一个名为ShiftedBronzes的基准数据集。通过大幅扩充青铜鼎数据集,ShiftedBronzes融合了两类青铜器数据和七类典型的分布偏移数据,覆盖了青铜器年代判定中常见的分布变化。我们在该数据集及五个常用通用OOD数据集上进行了基准测试,采用多种主流后处理、基于预训练视觉大模型(VLM)和生成式OOD检测方法。实验结果验证了以往关于各类方法的结论,同时揭示了它们在专业领域数据上的行为差异。这些发现凸显了将通用OOD检测方法应用于青铜器年代等特定任务时的独特挑战。我们期望ShiftedBronzes能为青铜器研究及OOD检测方法的发展提供重要参考。数据集与代码后续公开。
原文摘要 · Abstract (English)
In real-world applications across specialized domains, addressing complex out-of-distribution (OOD) challenges is a common and significant concern. In this study, we concentrate on the task of fine-grained bronze ware dating, a critical aspect in the study of ancient Chinese history, and developed a benchmark dataset named ShiftedBronzes. By extensively expanding the bronze Ding dataset, ShiftedBronzes incorporates two types of bronze ware data and seven types of OOD data, which exhibit distribution shifts commonly encountered in bronze ware dating scenarios. We conduct benchmarking experiments on ShiftedBronzes and five commonly used general OOD datasets, employing a variety of widely adopted post-hoc, pre-trained Vision Large Model (VLM)-based and generation-based OOD detection methods. Through analysis of the experimental results, we validate previous conclusions regarding post-hoc, VLM-based, and generation-based methods, while also highlighting their distinct behaviors on specialized datasets. These findings underscore the unique challenges of applying general OOD detection methods to domain-specific tasks such as bronze ware dating. We hope that the ShiftedBronzes benchmark provides valuable insights into both the field of bronze ware dating and the and the development of OOD detection methods. The dataset and associated code will be available later.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。