测试AI助非母语者理解新词，发现解释型工具最有效但用户自我感觉过强。
Reheat Nachos for Dinner? Evaluating AI Support for Cross-Cultural Communication of Neologisms
- 用AI解释新词含义和用法，显著提升沟通能力评分
- 不同支持方式对使用恰当性判断无明显差异
- 用户自评高于实际表现，提示需改进AI反馈机制
新词和新兴俚语是日常交流的核心，但对非母语者（NNS）在跨文化沟通中理解与使用构成挑战。越来越多的NNS借助人工智能（AI）工具学习这些词汇。我们通过一项包含234名参与者的人类受试研究，评估了三种AI支持方式（定义、简化重写、解释意义与用法）在非正式沟通场景中的效果，并与非AI词典对照。结果显示，相较于无支持，仅「解释」类支持能显著提升母语者（NS）对NNS写作的沟通能力评分；但在对语境恰当性的判断上，各支持方式无显著差异。此外，NNS的自我感知普遍高于实际评分，反映出感知与真实能力间的差距。研究还发现NNS与NS生成文本间存在显著差异，揭示当前AI工具的局限性，为未来设计提供依据。
原文摘要 · Abstract (English)
Neologisms and emerging slang are central to daily conversation, yet challenging for non-native speakers (NNS) to interpret and use appropriately in cross-cultural communication with native speakers (NS). NNS increasingly make use of Artificial Intelligence (AI) tools to learn these words. We study the utility of such tools in mediating an informal communication scenario through a human-subjects study (N=234): NNS participants learn English neologisms with AI support, write messages using the learned word to an NS friend, and judge contextual appropriateness of the neologism in two provided writing samples. Using both NS evaluator-rated communicative competence of NNS-produced writing and NNS' contextual appropriateness judgments, we compare three AI-based support conditions: AI Definition, AI Rewrite into simpler English, AI Explanation of meaning and usage, and Non-AI Dictionary for comparison. We show that AI Explanation yields the largest gains over no support in NS-rated competence, while contextual appropriateness judgments show indifference across support. NNS participants' self-reported perceptions tend to overestimate NS ratings, revealing a mismatch between perceived and actual competence. We further observe a significant gap between NNS- and NS-produced writing, highlighting the limitations of current AI tools and informing design for future tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。