多语言句子嵌入可替代翻译,实现跨语言可靠性审计。
Multilingual Sentence Embeddings for Linguistic-Integrated Reliability Audit

- 用母语嵌入代替翻译输入进行评估
- 可靠性指标与翻译法基本一致
- 能恢复翻译失败时丢失的答题数据
多语言评估系统通常依赖翻译来进行评分和质量控制。本文评估多语言句子嵌入是否可在11个PIRLS构造性作答题上,取代翻译后的英文输入,用于语言整合可靠性审计(LiRA)。结果显示,使用母语嵌入所得的可靠性估计值与翻译法非常接近,且能恢复翻译失败时被排除的作答,可靠性未出现显著变化。
原文摘要 · Abstract (English)
Multilingual assessment systems commonly rely on translation for scoring and quality-control processes. We evaluate whether multilingual sentence embeddings can replace translated English input for Linguistic-Integrated Reliability Auditing (LiRA) across 11 PIRLS constructed-response items and three embedding models. Native-language embeddings reproduced translation-based reliability estimates closely while recovering responses excluded after translation failure, with no meaningful change in reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。