arXiv:2606.06004cs.CL2026-06

用12条指南防止大模型在方言资源建设中造成语言消亡

The Generator-Eraser Paradox: Community Guidelines for Responsible LLM-Assisted Dialect Resource Creation

  • 提出'生成-消解悖论'理论框架,揭示大模型对方言的双重影响
  • 针对阿拉伯语方言案例,验证指南能缓解正字法同质化与话语权失衡
  • 为弱势语言社区提供可落地的设计准则,保障语言主权与多样性

方言资源兼具科学描述、文化保存与计算基础设施的多重属性。大语言模型虽能通过检索引导撰写、语料导航、元数据增强和标注流程支持加速资源建设,但也存在显著风险:优先推崇主流变体、统一拼写规则,并形成合成反馈循环,长期削弱语言多样性。这些风险在存在双语现象、书面标准缺失或边缘化社群的语言中尤为突出。本文提出三项贡献:一,整合变异社会语言学与语料语言学,将该矛盾形式化为‘生成-消解悖论’理论框架;二,推导出12条可操作的社区指南,用于指导方言资源创建与文档编制;三,以阿拉伯语方言为例,系统比较主流资源,展示指南如何应对双语现象、拼写不一致及社群治理等具体挑战。本研究为概念性与操作性成果,旨在使跨语言的方言社群与资源建设者在使用大模型时,不牺牲语言真实性、变异性和自主权。

原文摘要 · Abstract (English)

Dialect resources occupy a unique position at the intersection of scientific description, cultural preservation, and computational infrastructure. Large language models offer powerful capabilities for accelerating dialect resource development through retrieval-grounded drafting, corpus navigation, metadata enrichment, and annotation workflow support. However, the same systems pose substantial risks: they can contribute to dialect erasure by privileging prestige varieties, homogenizing orthography, and enabling synthetic feedback loops that reduce linguistic diversity over time. These risks are particularly acute for language varieties characterized by diglossia, limited written standardization, or marginalized speaker communities. This paper makes three contributions. First, we integrate insights from variationist sociolinguistics and corpus linguistics to formalize the generator-eraser paradox as a theoretical framework for understanding the dual nature of LLM-assisted dialect work. Second, we derive 12 community guidelines that operationalize this framework into implementable design requirements for dialect resource creation and documentation. Third, we provide an in-depth case study of Arabic dialects, including a structured comparison of widely used resources, to demonstrate how these guidelines address language-specific challenges including diglossia, orthographic variability, and community governance. The contribution is conceptual and operational rather than experimental, with the goal of enabling dialect communities and resource builders across languages to adopt LLMs without sacrificing authenticity, variation, or sovereignty.

大模型伦理方言保护语言多样性社区指南

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。