通过一致性约束从单一数据源生成独立决策因子,提升图神经网络在少量标注下的鲁棒性。
Differentiated Information Mining: A Semi-supervised Learning Framework for GNNs
- 从单源数据中提取差异化因子并强制其一致性,避免伪标签偏差
- 通过最短阶段原则筛选伪标签,减少模型过自信现象
- 兼容外部知识源,适合低标注场景的图学习任务
在半监督学习中,利用相互独立的决策因子进行交叉验证可有效缓解伪标签确认偏差和训练崩溃问题。然而实践中获取此类因子极具挑战:额外有效信息源稀缺,且即便存在也难以保证与原始来源的独立性。为此,本文提出差异化因子一致性半监督框架(DiFac),从单一信息源中衍生出差异化因子并强制其一致性。预训练阶段模型学习提取这些因子;训练阶段则迭代剔除因子冲突样本,并基于最短阶段原则对伪标签排序,选取最优候选样本以降低常见于置信度或集成方法中的过自信问题。该框架亦可融入额外信息源,本文利用大规模多模态语言模型引入隐式文本知识作为辅助决策因子,并设计问责评分机制以缓解由此带来的误判。在多个基准数据集上的实验表明,DiFac在低标注场景下持续提升模型鲁棒性与泛化能力,优于现有基线方法。
原文摘要 · Abstract (English)
In semi-supervised learning (SSL) for enhancing the performance of graph neural networks (GNNs) with unlabeled data, introducing mutually independent decision factors for cross-validation is regarded as an effective strategy to alleviate pseudo-label confirmation bias and training collapse. However, obtaining such factors is challenging in practice: additional and valid information sources are inherently scarce, and even when such sources are available, their independence from the original source cannot be guaranteed. To address this challenge, In this paper we propose a Differentiated Factor Consistency Semi-supervised Framework (DiFac), which derives differentiated factors from a single information source and enforces their consistency. During pre-training, the model learns to extract these factors; in training, it iteratively removes samples with conflicting factors and ranks pseudo-labels based on the shortest stave principle, selecting the top candidate samples to reduce overconfidence commonly observed in confidence-based or ensemble-based methods. Our framework can also incorporate additional information sources. In this work, we leverage the large multimodal language model to introduce latent textual knowledge as auxiliary decision factors, and we design a accountability scoring mechanism to mitigate additional erroneous judgments introduced by these auxiliary factors. Experiments on multiple benchmark datasets demonstrate that DiFac consistently improves robustness and generalization in low-label regimes, outperforming other baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。