构建多模态语料库，研究视障与健全人对话中的手势差异
Did somebody say "Gest-IT"? A pilot exploration of multimodal data management
- 三层标注：文字、语调、手势同步转录
- 首次系统记录视障者对话手势模式变化
- 适合语言学、人机交互与无障碍技术研究者
本文开展了一项关于多模态语料库构建、管理与分析的初步探索。通过文字、语调和手势的三层标注，Gest-IT资源使我们能够研究健全人与视障人士在对话中手势生成模式的差异。文章讨论了转录方法与技术流程，并提出统一的CoNLL-U语料格式，为后续研究奠定基础。
原文摘要 · Abstract (English)
The paper presents a pilot exploration of the construction, management and analysis of a multimodal corpus. Through a three-layer annotation that provides orthographic, prosodic, and gestural transcriptions, the Gest-IT resource allows to investigate the variation of gesture-making patterns in conversations between sighted people and people with visual impairment. After discussing the transcription methods and technical procedures employed in our study, we propose a unified CoNLL-U corpus and indicate our future steps
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。