从婴儿视角研究触觉如何辅助视觉学习,构建了大规模触觉数据集。
Making Sense of Touch from the Child's View for Contrastive Learning

- 基于婴儿视角设计触觉事件编码体系,采集26.4万段触觉视频片段。
- 用该数据集预训练发育性模型,揭示触觉对视觉学习的关键作用。
- 适合儿童认知发展、多模态学习与早期智能研究者参考。
触觉是否是婴儿学习视觉概念的机制?若如此,其重要性可量化吗?婴儿在视觉学习中有多依赖触觉?为系统回答这些问题,我们提出一种以婴儿为中心的触觉事件结构化编码体系,构建了一个包含26.4万段两秒触觉视频片段的数据集。利用该数据集,我们预训练了具有发育基础的模型,揭示了触觉在婴儿学习过程中的重要作用,为理解婴幼儿认知发展提供了新的实证依据。
原文摘要 · Abstract (English)
Is the sense of touch a mechanism for human babies' learning of visual concepts? If so, can we quantify its importance, and to what extent do babies rely on their sense of touch for visual learning? To approach these questions in a principled way, we propose a structured coding system for baby-centric touch events, yielding a dataset of 264k two-second clips of touch events coded according to this system. Using this dataset, we pretrain developmentally grounded models that reveal promising insights into the nature of baby learning from touch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。