构建大规模鸟类细粒度识别知识追踪数据集,助力研究人类视觉专家能力发展。
CleverBirds: A Multiple-Choice Benchmark for Fine-grained Human Knowledge Tracing
- 基于eBird平台收集4万+参与者答题数据,覆盖超1万种鸟类
- 平均每人答400题,总题量超1700万道,含长期学习模式
- 适用于研究视觉专家能力演化,尤其适合知识追踪与个性化学习
掌握细粒度视觉识别对多个专业领域至关重要,但建模人类专家能力的演进仍具挑战。本文提出CleverBirds,一个大规模鸟类物种识别的知识追踪基准。数据由公民科学平台eBird收集,超过4万名参与者回答了超过1700万道多选题,涵盖超过10,000种鸟类,每人平均参与400题,展现出长期学习模式。该数据集支持视觉知识追踪方法的研发与评估。研究表明,追踪学习者知识状态极具挑战性,尤其在不同用户群体和题型间存在差异,不同上下文信息提供的预测价值也各不相同。CleverBirds是同类中规模最大的基准之一,包含更多可学习概念。我们期望它能推动视觉专家能力随时间与个体变化的研究新方向。
原文摘要 · Abstract (English)
Mastering fine-grained visual recognition, essential in many expert domains, can require that specialists undergo years of dedicated training. Modeling the progression of such expertize in humans remains challenging, and accurately inferring a human learner's knowledge state is a key step toward understanding visual learning. We introduce CleverBirds, a large-scale knowledge tracing benchmark for fine-grained bird species recognition. Collected by the citizen-science platform eBird, it offers insight into how individuals acquire expertize in complex fine-grained classification. More than 40,000 participants have engaged in the quiz, answering over 17 million multiple-choice questions spanning over 10,000 bird species, with long-range learning patterns across an average of 400 questions per participant. We release this dataset to support the development and evaluation of new methods for visual knowledge tracing. We show that tracking learners' knowledge is challenging, especially across participant subgroups and question types, with different forms of contextual information offering varying degrees of predictive benefit. CleverBirds is among the largest benchmark of its kind, offering a substantially higher number of learnable concepts. With it, we hope to enable new avenues for studying the development of visual expertize over time and across individuals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。