解决异构图多标签分类中的注意力稀释与覆盖约束矛盾。
FOCAL-Attention for Heterogeneous Multi-Label Prediction

- 设计双组件注意力机制,分别处理全局上下文与关键路径语义。
- 在多个数据集上超越现有方法,最高提升6.2%准确率。
- 适合处理复杂系统中多类型实体与关系的多标签预测任务。
异构图因能建模复杂现实系统中多种类型实体与关系而受到关注。在异构图上进行多标签节点分类面临结构异质性及跨标签共享表征的挑战。现有方法通常采用灵活注意力或元路径约束锚定,但在多标签监督下易出现语义稀释或覆盖约束问题,且二者矛盾随标签增多加剧。本文通过理论分析发现:随着异构邻域扩大,分配给任务关键(主要)邻域的注意力质量下降;而元路径约束聚合存在两难——路径过少强化覆盖限制,过多则重引入稀释。为解决这一覆盖-锚定冲突,提出FOCAL:融合覆盖与锚定学习框架,包含面向覆盖的注意力(COA)用于灵活无约束的异构上下文聚合,以及面向锚定的注意力(AOA)将聚合限制于元路径诱导的主要语义。理论分析与实验结果表明,FOCAL性能优于当前最优方法。
原文摘要 · Abstract (English)
Heterogeneous graphs have attracted increasing attention for modeling multi-typed entities and relations in complex real-world systems. Multi-label node classification on heterogeneous graphs is challenging due to structural heterogeneity and the need to learn shared representations across multiple labels. Existing methods typically adopt either flexible attention mechanisms or meta-path constrained anchoring, but in heterogeneous multi-label prediction they often suffer from semantic dilution or coverage constraint. Both issues are further amplified under multi-label supervision. We present a theoretical analysis showing that as heterogeneous neighborhoods expand, the attention mass allocated to task-critical (primary) neighborhoods diminishes, and that meta-path constrained aggregation exhibits a dilemma: too few meta-paths intensify coverage constraint, while too many re-introduce dilution. To resolve this coverage-anchoring conflict, we propose FOCAL: Fusion Of Coverage and Anchoring Learning, with two components: coverage-oriented attention (COA) for flexible, unconstrained heterogeneous context aggregation, and anchoring-oriented attention (AOA) that restricts aggregation to meta-path-induced primary semantics. Our theoretical analysis and experimental results further indicates that FOCAL has a better performance than other state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。