用AI检测问卷翻译难题,提升多语言调查数据可靠性
Exploring the Potential Role of Generative AI in the TRAPD Procedure for Survey Translation
- 用ChatGPT零样本提示识别问卷中难译的语言与概念特征
- 发现AI可有效指出源语言问题、概念不一致及文化敏感性风险
- 适合资源有限的跨文化调查团队快速筛查翻译隐患
本文探讨生成式AI在调查问卷翻译中的应用潜力。撰写高质量问卷是复杂任务,尤其在多语言多文化场景下更易出错,错误可能导致数据无效或结论偏差。随着学术与机构调查日益全球化,依赖研究人员与译者经验及时间投入,资源不足团队面临较高翻译误差风险。本研究采用零样本提示实验,使用ChatGPT评估其识别问卷中难以翻译特征的能力。结果表明,ChatGPT能提供关于源语言表达、概念不一致、敏感性与正式度问题及不存在概念的有效反馈。同时,文章详细说明了该方法的可行性,包括软件获取方式、成本及计算耗时。基于成果,提出未来将AI整合进调查翻译流程的研究方向。
原文摘要 · Abstract (English)
This paper explores and assesses in what ways generative AI can assist in translating survey instruments. Writing effective survey questions is a challenging and complex task, made even more difficult for surveys that will be translated and deployed in multiple linguistic and cultural settings. Translation errors can be detrimental, with known errors rendering data unusable for its intended purpose and undetected errors leading to incorrect conclusions. A growing number of institutions face this problem as surveys deployed by private and academic organizations globalize, and the success of their current efforts depends heavily on researchers' and translators' expertise and the amount of time each party has to contribute to the task. Thus, multilinguistic and multicultural surveys produced by teams with limited expertise, budgets, or time are at significant risk for translation-based errors in their data. We implement a zero-shot prompt experiment using ChatGPT to explore generative AI's ability to identify features of questions that might be difficult to translate to a linguistic audience other than the source language. We find that ChatGPT can provide meaningful feedback on translation issues, including common source survey language, inconsistent conceptualization, sensitivity and formality issues, and nonexistent concepts. In addition, we provide detailed information on the practicality of the approach, including accessing the necessary software, associated costs, and computational run times. Lastly, based on our findings, we propose avenues for future research that integrate AI into survey translation practices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。