解决零膨胀分布下时空图学习的少数类性能差距问题
Alleviating Performance Disparity in Adversarial Spatiotemporal Graph Learning Under Zero-Inflated Distribution
- 设计多维注意力重加权时空梯度,缓解类别间梯度差异
- 引入不确定性引导对比损失,提升少数类表示可分性
- 在犯罪预测等任务中显著降低少数类性能差距
在零膨胀分布(ZID)下的时空图学习(SGL)对城市风险管控(如犯罪预测、交通事故分析)至关重要。然而,现有模型易受对抗攻击影响,且传统对抗训练会加剧多数类与少数类之间的性能差距,导致关键风险事件因低报而无法挽回。本文揭示少数类梯度较小、可分性差是核心原因。为此提出MinGRE框架,通过多维注意力机制重加权时空梯度,缩小跨类梯度分布差异;并引入不确定性引导的对比损失,增强高不确定性的少数类表示的类间可分性与类内紧凑性。大量实验表明,该方法不仅显著降低类别间性能差距,还优于现有基线,在鲁棒性上表现更优。
原文摘要 · Abstract (English)
Spatiotemporal Graph Learning (SGL) under Zero-Inflated Distribution (ZID) is crucial for urban risk management tasks, including crime prediction and traffic accident profiling. However, SGL models are vulnerable to adversarial attacks, compromising their practical utility. While adversarial training (AT) has been widely used to bolster model robustness, our study finds that traditional AT exacerbates performance disparities between majority and minority classes under ZID, potentially leading to irreparable losses due to underreporting critical risk events. In this paper, we first demonstrate the smaller top-k gradients and lower separability of minority class are key factors contributing to this disparity. To address these issues, we propose MinGRE, a framework for Minority Class Gradients and Representations Enhancement. MinGRE employs a multi-dimensional attention mechanism to reweight spatiotemporal gradients, minimizing the gradient distribution discrepancies across classes. Additionally, we introduce an uncertainty-guided contrastive loss to improve the inter-class separability and intra-class compactness of minority representations with higher uncertainty. Extensive experiments demonstrate that the MinGRE framework not only significantly reduces the performance disparity across classes but also achieves enhanced robustness compared to existing baselines. These findings underscore the potential of our method in fostering the development of more equitable and robust models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。