用博弈对抗方式自动清除大模型伪标签中的幻觉错误。
The Label Imitation Game: Turing Test Network for Zero-Shot Pseudo-Label Pruning

- 设计对抗性评判网络,基于上下文全局评估伪标签真伪。
- 在四大数据集上提升伪标签准确率,类别最差时F1增28%。
- 无需标注或重训,可跨任务迁移,适合零样本场景应用。
基于基础模型的零样本伪标签方法虽能实现大规模标注,但易受幻觉干扰,常规阈值难以应对。本文提出受图灵测试启发的标签模仿游戏(LIG),将伪标签过滤建模为对抗式质询。通过训练一个与任务无关的“评判器”——图灵测试网络(TTN),在全局数据语境中评估候选伪标签。在四个多样化数据集上的实验表明,该方法显著提升三种顶尖视觉-语言模型的伪标签精度,无需额外标注或重训练。关键发现:学习到的语义上下文逻辑可替代空间几何验证,实现独特零样本任务迁移——仅在图像分类数据上训练的TTN,即可有效修剪复杂目标检测伪标签,使最差类别F1提升28%,结合任务微调达44%。此外,观察到“类别复兴”现象,即TTN净化了下游模型的训练信号,使其恢复对易退化类别的零召回性能。预训练模型与代码已开源:https://github.com/voxel51/ttn。
原文摘要 · Abstract (English)
Foundation model pseudo-labeling - labeling data strictly via zero-shot inference - enables massive scale, but performance is undermined by hallucinations that evade standard thresholds. To eliminate these errors, we introduce the Turing-inspired Label Imitation Game (LIG), a framework that formalizes pseudo-label pruning as an adversarial interrogation. Rather than filtering labels via isolated thresholds, we use the LIG to train a Turing Test Network (TTN), a task-agnostic "judge" that evaluates candidate pseudo-labels within a dataset-wide context. Experiments across four diverse datasets demonstrate the TTN's robustness, consistently enhancing label accuracy for three state-of-the-art vision-language models without costly supervision or retraining. Crucially, we demonstrate that learned semantic-contextual logic is a robust alternative to spatial-geometric verification, enabling a unique zero-shot task transfer capability - a TTN trained strictly on image classification datasets can effectively prune complex object detection pseudo-labels. This pruning yields F1-score gains of 28% for the worst-performing baseline categories and 44% with task-specific fine-tuning. Significantly, we also observe Category Revival, where the TTN pruning "detoxifies" the training signal for downstream models and enables them to recover from zero recall on transfer-vulnerable classes. The pre-trained TTN models and code are available at https://github.com/voxel51/ttn.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。