arXiv:2605.25541cs.CGcs.AI2026-05被引 1

用拓扑方法可视化对比模型表示结构,揭示深层语义对齐关系。

TopoAlign: Topology-Aware Visual Representation Alignment

论文配图:TopoAlign: Topology-Aware Visual Representation Alignment
图 1 · 摘自论文原文
  • 基于拓扑数据分析构建映射图,从全局结构对比模型表示
  • 通过联合力导向优化实现图布局协同,识别结构匹配区域
  • 适合模型解释、对比分析及多模态研究者使用

神经网络将输入编码为高维向量表示,反映模型处理数据的结构与语义。表示对齐指不同模型、层或训练条件对相同输入生成相似表示的程度,对模型解释、选择和鲁棒性分析至关重要。现有方法主要依赖几何属性(如邻域和聚类相似性),难以揭示表示的全局组织结构。本文提出TopoAlign,一种拓扑感知的视觉表示对齐框架。利用拓扑数据分析中的mapper图,联合分析跨不同模型或层的共享输入表示所构建的图。该框架支持自上而下的比较流程:首先通过联合力导向优化实现全局结构对齐,生成协调的图布局;接着自动检测结构匹配区域,以气泡集可视化;最后通过基序查询和膜状可视化实现细粒度模式探索。我们在语言和多模态模型上进行案例研究,并获得专家反馈。结果表明,TopoAlign从拓扑视角提供了关于表示结构与对齐的有意义洞察。

原文摘要 · Abstract (English)

Neural networks encode inputs as high-dimensional vectors, known as representations, that capture how models process data by encoding task-relevant structure and semantics. Representation alignment refers to the degree to which different models, layers, or training conditions produce similar representations for the same inputs, with important implications for model interpretation, selection, and robustness analysis. Existing approaches to measure alignment primarily rely on geometric properties, such as neighborhood and cluster similarity, offering limited insight into the global organization of representations. In this work, we present TopoAlign, a topology-aware framework for visually comparing model representations from a structural perspective. Leveraging mapper graphs from topological data analysis, TopoAlign jointly analyzes graphs constructed from representations of shared inputs across different models or layers. The framework supports a top-down comparative workflow: it first performs global structure alignment via joint force-directed optimization to produce coordinated graph layouts; it then identifies local correspondences through automated detection of structurally matching regions, visualized with Bubble Sets; and finally it enables fine-grained pattern inspection through motif-based queries and membrane-inspired visualizations. We demonstrate TopoAlign through case studies on language and multimodal models, complemented by expert feedback. Our results show that TopoAlign provides meaningful insights into representation structure and alignment from a topological perspective.

表示对齐拓扑分析模型解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。