用计算机视觉分析真实场景中物体数量与非数量特征的分布规律。
Estimating the distribution of numerosity and non-numerical visual magnitudes in natural scenes using computer vision
- 构建新算法管道,从真实图像中估算物体数量和非数量特征分布。
- 发现自然场景中物体数量服从幂律分布,且与连续特征相关性稳定。
- 为理解人类数量判断中的非数量干扰提供生态学依据,适合认知科学与视觉研究者。
人类与多种动物共享对视觉场景中物体数量的感知与近似表征能力,这种能力随儿童成长而提升,提示学习与发育在塑造数感中起关键作用。深度学习研究显示,神经网络在学习图像中物品数量变化的统计结构时,可自发产生数量感知能力。然而,现有模型多基于合成数据,可能无法真实反映自然环境的统计特性。本文利用计算机视觉最新进展,设计并实现一套新方法,用于大规模真实图像数据集(数千张日常场景图)中物体数量及非数量视觉特征分布的估计。结果表明,在自然视觉场景中,不同数量出现频率符合幂律分布;同时,数量与连续特征间的相关结构在不同数据集和场景类型(同质与异质物体集)间保持稳定。研究建议,考虑此类“生态”协变模式对理解非数量视觉线索如何影响数量判断至关重要。
原文摘要 · Abstract (English)
Humans share with many animal species the ability to perceive and approximately represent the number of objects in visual scenes. This ability improves throughout childhood, suggesting that learning and development play a key role in shaping our number sense. This hypothesis is further supported by computational investigations based on deep learning, which have shown that numerosity perception can spontaneously emerge in neural networks that learn the statistical structure of images with a varying number of items. However, neural network models are usually trained using synthetic datasets that might not faithfully reflect the statistical structure of natural environments, and there is also growing interest in using more ecological visual stimuli to investigate numerosity perception in humans. In this work, we exploit recent advances in computer vision algorithms to design and implement an original pipeline that can be used to estimate the distribution of numerosity and non-numerical magnitudes in large-scale datasets containing thousands of real images depicting objects in daily life situations. We show that in natural visual scenes the frequency of appearance of different numerosities follows a power law distribution. Moreover, we show that the correlational structure for numerosity and continuous magnitudes is stable across datasets and scene types (homogeneous vs. heterogeneous object sets). We suggest that considering such "ecological" pattern of covariance is important to understand the influence of non-numerical visual cues on numerosity judgements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。