arXiv:2502.04398cs.LGcs.GR2025-02

早预测手部动作意图,用多视角可视化提升可解释性

XMTC: Explainable Early Classification of Multivariate Time Series in Reach-to-Grasp Hand Kinematics

  • 集成多种模型并加权,实现多变量时间序列的早期分类
  • 在真实人机交互场景中,实现高准确率的早期动作预测
  • 通过可视化工具分析预测过程,帮助理解关键特征与难点

在人机交互中,通过多个手部传感器捕捉多变量时间序列数据,旨在预测用户执行抓取动作时的意图。面对多种可能的动作与对象,目标是在尽可能早的阶段完成分类。尽管已有多种机器学习方法表现良好,但效果因数据集而异。为此,本文采用集成方法融合并加权不同模型。为增强分类结果的可信度,提出XMTC工具,整合多视图可视化:时序准确率图、混淆矩阵热图、时序置信度热图与部分依赖图,帮助识别早期预测与精度间的最佳平衡,检测困难分类条件,并以概览与细节结合的方式分析预测演化过程。在多个真实场景的HCI数据上验证,表明该方法可在早期实现高质量分类,明确易区分的条件、具有挑战性的测量信号及影响最大的特征。

原文摘要 · Abstract (English)

Hand kinematics can be measured in Human-Computer Interaction (HCI) with the intention to predict the user's intention in a reach-to-grasp action. Using multiple hand sensors, multivariate time series data are being captured. Given a number of possible actions on a number of objects, the goal is to classify the multivariate time series data, where the class shall be predicted as early as possible. Many machine-learning methods have been developed for such classification tasks, where different approaches produce favorable solutions on different data sets. We, therefore, employ an ensemble approach that includes and weights different approaches. To provide a trustworthy classification production, we present the XMTC tool that incorporates coordinated multiple-view visualizations to analyze the predictions. Temporal accuracy plots, confusion matrix heatmaps, temporal confidence heatmaps, and partial dependence plots allow for the identification of the best trade-off between early prediction and prediction quality, the detection and analysis of challenging classification conditions, and the investigation of the prediction evolution in an overview and detail manner. We employ XMTC to real-world HCI data in multiple scenarios and show that good classification predictions can be achieved early on with our classifier as well as which conditions are easy to distinguish, which multivariate time series measurements impose challenges, and which features have most impact.

时间序列动作预测可解释性人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。