用自动语音技术分析婴幼儿自然环境录音,挖掘早期发展线索。
Automated Analysis of Naturalistic Recordings in Early Childhood: Applications, Challenges, and Opportunities
- 通过语音分离、说话人识别等技术解析婴幼儿长时间自然录音
- 现有模型对幼儿语音识别准确率有限,但已能提供发展洞察
- 适合儿童发展研究者与语音处理学者跨领域合作
自然主义录音在真实环境中无干扰地记录参与者行为,长时连续录音可覆盖数小时甚至数天的日常互动。该方法广泛用于心理学、教育学、认知科学和临床研究中,观察儿童在真实场景下的社交与认知发展。随着语音技术和机器学习的进步,研究人员开始尝试自动系统化分析大规模儿童自然录音数据。尽管当前模型在幼儿语音处理上仍存在准确率不足的问题,但已展现出揭示儿童认知与社会发展的潜力。关键技术支持包括说话人分离、发声分类、成人话语量估算、说话人验证及代码切换的语言分离。这些技术多为成人设计,针对幼儿的专门研究仍严重不足。本文综述了当前进展、挑战与机遇,旨在推动信号处理与跨学科合作,促进面向3岁以下婴幼儿自然录音分析的技术发展。
原文摘要 · Abstract (English)
Naturalistic recordings capture audio in real-world environments where participants behave naturally without interference from researchers or experimental protocols. Naturalistic long-form recordings extend this concept by capturing spontaneous and continuous interactions over extended periods, often spanning hours or even days, in participants' daily lives. Naturalistic recordings have been extensively used to study children's behaviors, including how they interact with others in their environment, in the fields of psychology, education, cognitive science, and clinical research. These recordings provide an unobtrusive way to observe children in real-world settings beyond controlled and constrained experimental environments. Advancements in speech technology and machine learning have provided an initial step for researchers to automatically and systematically analyze large-scale naturalistic recordings of children. Despite the imperfect accuracy of machine learning models, these tools still offer valuable opportunities to uncover important insights into children's cognitive and social development. Several critical speech technologies involved include speaker diarization, vocalization classification, word count estimate from adults, speaker verification, and language diarization for code-switching. Most of these technologies have been primarily developed for adults, and speech technologies applied to children specifically are still vastly under-explored. To fill this gap, we discuss current progress, challenges, and opportunities in advancing these technologies to analyze naturalistic recordings of children during early development (<3 years of age). We strive to inspire the signal processing community and foster interdisciplinary collaborations to further develop this emerging technology and address its unique challenges and opportunities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。