提出本地化流程,精准区分学生姓名与课程术语,保护隐私同时不误删教学内容。
Redact or Keep? A Fully Local AI Cascade for Educational Dialogue De-Identification

- 用双轻量编码器+规则生成候选,再以上下文判断是否删除
- 本地运行达0.958宏F1,远超商用API的0.706和同族模型的0.767
- 适合教育数据研究者,尤其关注隐私与准确性的场景
教育对话是研究宝贵但敏感的资源:同一段记录可能包含真实学生信息与课程内容交织的个人身份信息(PII),例如“Riemann”既可能是学生名也可能是数学概念。现有方法在治理与准确性间权衡:商业大模型能处理歧义但需上传数据,本地命名实体识别系统虽保安全却过度删除课程术语。本文提出完全本地的级联框架,将去标识化从开放式实体识别重构为受限隐私筛选。首先通过两个轻量编码器结合确定性规则过生成候选片段;随后,上下文感知的审查模块基于对话上下文与发言者角色对每个候选做出“删除/保留”的二分类决策。在两大平台的数学辅导对话上评估三种审查配置,最强本地方案达到0.958宏F1,优于同族模型的0.767与商用API的0.706,且仅需单台笔记本运行。针对课程-人名歧义的专项测试集,该方案仅下降0.03 F1,而小型审查器下降0.19至0.25。结果表明,在教育去标识化中,问题建模比模型规模更重要。
原文摘要 · Abstract (English)
Educational dialogue is a valuable but sensitive resource for research: the same transcripts that capture authentic learning often capture personally identifiable information (PII) entangled with curricular content, where "Riemann" may refer to a real student or to a mathematical concept. Existing approaches force a tradeoff between governance and accuracy. Commercial Large Language Models (LLMs) can handle this ambiguity but require sending student data to third parties, while local named entity recognition (NER) systems preserve governance but over-redact curricular terms. We propose a fully local cascade framework that reframes de-identification from open-ended entity recognition to constrained privacy triage. A recall-first union proposer combines two lightweight encoders with deterministic rules to over-generate candidate spans; a context-aware reviewer then makes a binary Redact/Keep decision for each candidate using surrounding dialogue and speaker role. We evaluate three reviewer configurations against same-family LLM-only baselines and a commercial API on math tutoring transcripts from two large platforms. The strongest local configuration reaches 0.958 macro F1, compared with 0.767 for a same-family LLM-only baseline and 0.706 for the commercial API, while running entirely on a single laptop. On a targeted challenge set of curricular-personal name ambiguity, the same configuration degrades by only 0.03 F1 versus 0.19 to 0.25 for smaller reviewers. These results suggest that for educational de-identification, problem formulation matters more than model scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。