用几何视角解析RNN如何识别用户意图,揭示数据不平衡的影响。
Interpretability of the Intent Detection Problem: A New Approach
- 将句子视为隐藏状态空间中的轨迹,分析RNN的几何解构机制。
- 平衡数据下意图聚类清晰;不平衡数据导致低频意图聚类退化。
- 为真实性能差异提供新解释,适合研究模型可解释性与数据偏移者。
意图检测是文本分类的基础任务,旨在识别和标注用户查询的语义,在众多商业应用中至关重要。尽管深度学习技术占据主导地位,但人们对循环神经网络(RNN)解决该任务的内部机制仍知之甚少。本文运用动力系统理论分析RNN架构如何应对意图检测问题,采用平衡的SNIPS和不平衡的ATIS数据集。通过将句子视为隐藏状态空间中的轨迹,我们首先发现,在平衡的SNIPS数据集上,网络学习到理想解:状态空间被限制在低维流形上,并划分为对应各意图的独立簇。将该框架应用于不平衡的ATIS数据集后,揭示了类别不平衡如何扭曲这一理想几何解,导致低频意图的簇质量下降。本框架将几何分离与读出对齐解耦,为现实世界性能差异提供了新颖的机制性解释。这些发现深化了对RNN动态的理解,从几何角度展示了数据集特性如何直接影响网络的计算解。
原文摘要 · Abstract (English)
Intent detection, a fundamental text classification task, aims to identify and label the semantics of user queries, playing a vital role in numerous business applications. Despite the dominance of deep learning techniques in this field, the internal mechanisms enabling Recurrent Neural Networks (RNNs) to solve intent detection tasks are poorly understood. In this work, we apply dynamical systems theory to analyze how RNN architectures address this problem, using both the balanced SNIPS and the imbalanced ATIS datasets. By interpreting sentences as trajectories in the hidden state space, we first show that on the balanced SNIPS dataset, the network learns an ideal solution: the state space, constrained to a low-dimensional manifold, is partitioned into distinct clusters corresponding to each intent. The application of this framework to the imbalanced ATIS dataset then reveals how this ideal geometric solution is distorted by class imbalance, causing the clusters for low-frequency intents to degrade. Our framework decouples geometric separation from readout alignment, providing a novel, mechanistic explanation for real world performance disparities. These findings provide new insights into RNN dynamics, offering a geometric interpretation of how dataset properties directly shape a network's computational solution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。