提出可解释的图文数据嵌入方法,提升检索与分类效果。
Effective Graph and Rank-based Contextual Embeddings for Textual and Multimedia Data

- 基于节点排名选择代表性子集,生成可解释嵌入
- 在文本与图像数据上优于现有方法,提升检索与分类性能
- 无需标签,适合缺乏标注的数据场景
在数据驱动的世界中,高效组织和映射对象间关系至关重要。图结构是建模这些连接的强大工具,广泛应用于社交网络、电信和生物学等领域。然而,图方法常面临高计算成本,尤其在内存和空间使用方面。为解决此问题,图嵌入技术(又称网络表示学习)将图信息编码为低维表示,同时保留结构特性。传统方法缺乏可解释维度。RaDE(Rank Diffusion Embedding)引入基于排名的信息,关键步骤是选择代表性节点子集以增强维度可解释性并改善检索任务。尽管有潜力,其原始方案未充分探索不同类别下代表性子集选择的有效性,也未在分类与聚类任务中评估嵌入效果。受RaDE启发,本文提出GRaCE(Graph and Rank-based Contextual Embeddings),一个完全无监督框架,通过鲁棒的基于排名的度量实现代表性子集选择与节点嵌入生成。GRaCE在多种数据集(包括文本与图像集合)上超越RaDE与原始特征,在检索、分类与聚类任务中表现优异,采用SOTA Transformer模型作为特征描述符,以及GCN模型进行分类任务。
原文摘要 · Abstract (English)
In a data-driven world, efficiently organizing and mapping relationships between objects is crucial. Graphs are powerful tools for modeling these connections, being widely used in social networks, telecommunications, and biology. However, graph-based methods often face high computational costs, particularly in memory and space usage. To address this, graph embedding techniques, also referred to as Network Representation Learning, encode graph information into lower-dimensional representations while preserving structural aspects. Traditional methods, however, lack interpretable dimensions. RaDE (Rank Diffusion Embedding) introduces a new approach using rank-based information, with a key step being the selection of a representative subset of nodes to provide interpretability for its dimensions and improve retrieval tasks. Despite its potential, RaDE's original proposal did not fully explore the effectiveness of representative subset selection across different classes or evaluate embeddings in tasks like classification and clustering. Inspired by RaDE, this work introduces GRaCE (Graph and Rank-based Contextual Embeddings), a fully unsupervised framework that generates interpretable embeddings by leveraging robust rank-based measures for representative subset selection and node embedding. GRaCE surpasses RaDE and Original Features across diverse datasets, including textual and image collections, excelling in retrieval, classification, and clustering tasks, considering state-of-the-art Transformer models as feature descriptors and Graph Convolutional Networks models in classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。